US20210255794A1 - Optimizing Data Write Size Using Storage Device Geometry - Google Patents

Optimizing Data Write Size Using Storage Device Geometry Download PDF

Info

Publication number
US20210255794A1
US20210255794A1 US17/306,025 US202117306025A US2021255794A1 US 20210255794 A1 US20210255794 A1 US 20210255794A1 US 202117306025 A US202117306025 A US 202117306025A US 2021255794 A1 US2021255794 A1 US 2021255794A1
Authority
US
United States
Prior art keywords
storage device
storage
memory
data
layout
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US17/306,025
Inventor
John Colgrove
Peter E. Kirkpatrick
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pure Storage Inc
Original Assignee
Pure Storage Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pure Storage Inc filed Critical Pure Storage Inc
Priority to US17/306,025 priority Critical patent/US20210255794A1/en
Assigned to PURE STORAGE, INC. reassignment PURE STORAGE, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: COLGROVE, JOHN, KIRKPATRICK, PETER E.
Publication of US20210255794A1 publication Critical patent/US20210255794A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/0644Management of space entities, e.g. partitions, extents, pools
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0632Configuration or reconfiguration of storage systems by initialisation or re-initialisation of storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608Saving storage space on storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0653Monitoring storage devices or systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0673Single storage device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0683Plurality of storage devices
    • G06F3/0689Disk arrays, e.g. RAID, JBOD

Definitions

  • the field of technology is methods, apparatuses, and products for exposing a geometry of a storage device.
  • Enterprise storage systems can provide large amounts of computer storage to modern enterprises.
  • the performance of such storage systems which is frequently measured in terms of throughput and latency, may be reduced as the storage devices may be required to perform operations other than servicing input/output (‘I/O’) operations.
  • I/O input/output
  • Methods, apparatus, and products for exposing a geometry of a storage device including: sending, by the storage device, information describing the layout of memory in the storage device; receiving, by the storage device, a write request, the write request associated with an amount of data sized in dependence upon the layout of memory in the storage device; and writing, by the storage device, the data to a memory unit, the data written to a location within the memory unit in dependence upon the layout of memory in the storage device.
  • FIG. 1 sets forth a block diagram of a system configured for exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 2 sets forth a block diagram of a storage array controller useful in exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 3 sets forth a block diagram of a storage device according to embodiments of the present disclosure.
  • FIG. 4 sets forth a flow chart illustrating an example method of exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 5 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 6 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 7 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 1 sets forth a block diagram of a system configured for exposing a geometry of a storage device according to embodiments of the present disclosure.
  • the system of FIG. 1 includes a plurality of computing devices ( 164 , 166 , 168 , 170 ).
  • Such computing devices may be implemented in a number of different ways.
  • a computing device may be a server in a data center, a workstation, a personal computer, a notebook, or the like.
  • the computing devices ( 164 , 166 , 168 , 170 ) in the example of FIG. 1 are coupled for data communications to one or more storage arrays ( 102 , 104 ) through a storage area network (‘SAN’) ( 158 ) as well as a local area network ( 160 ) (‘LAN’).
  • the SAN ( 158 ) may be implemented with a variety of data communications fabrics, devices, and protocols. Example fabrics for such a SAN ( 158 ) may include Fibre Channel, Ethernet, Infiniband, Serial Attached SCSI (‘SAS’), and the like.
  • Example data communications protocols for use in such a SAN may include Advanced Technology Attachment (‘ATA’), Fibre Channel Protocol, SCSI, iSCSI, HyperSCSI, and others. Readers of skill in the art will recognize that a SAN is just one of many possible data communications couplings which may be implemented between a computing device ( 164 , 166 , 168 , 170 ) and a storage array ( 102 , 104 ), and readers will further appreciate that any other data communications coupling is well within the scope of embodiments of the present disclosure.
  • ATA Advanced Technology Attachment
  • the local area network ( 160 ) of FIG. 1 may also be implemented with a variety of fabrics and protocols. Examples of such fabrics include Ethernet ( 802 . 3 ), wireless ( 802 . 11 ), and the like. Examples of such data communications protocols include Transmission Control Protocol (‘TCP’), User Datagram Protocol (‘UDP’), Internet Protocol (‘IP’), HyperText Transfer Protocol (‘HTTP’), Wireless Access Protocol (‘WAP’), Handheld Device Transport Protocol (‘HDTP’), Session Initiation Protocol (‘SIP’), Real Time Protocol (‘RTP’), and so on.
  • TCP Transmission Control Protocol
  • UDP User Datagram Protocol
  • IP Internet Protocol
  • HTTP HyperText Transfer Protocol
  • WAP Wireless Access Protocol
  • HDTP Handheld Device Transport Protocol
  • SIP Session Initiation Protocol
  • RTP Real Time Protocol
  • the example storage arrays ( 102 , 104 ) of FIG. 1 provide persistent data storage for the computing devices ( 164 , 166 , 168 , 170 ).
  • Each storage array ( 102 , 104 ) depicted in FIG. 1 includes one or more storage array controllers ( 106 , 112 ).
  • Each storage array controller ( 106 , 112 ) may be embodied as a module of automated computing machinery comprising computer hardware, computer software, or a combination of computer hardware and software.
  • the storage array controllers ( 106 , 112 ) may be configured to carry out various storage-related tasks.
  • Such tasks may include writing data received from the one or more of the computing devices ( 164 , 166 , 168 , 170 ) to storage, erasing data from storage, retrieving data from storage to provide the data to one or more of the computing devices ( 164 , 166 , 168 , 170 ), monitoring and reporting of disk utilization and performance, performing Redundant Array of Independent Drives (‘RAID’) or RAID-like data redundancy operations, compressing data, encrypting data, and so on.
  • RAID Redundant Array of Independent Drives
  • Each storage array controller ( 106 , 112 ) may be implemented in a variety of ways, including as an Field Programmable Gate Array (‘FPGA’), a Programmable Logic Chip (‘PLC’), an Application Specific Integrated Circuit (‘ASIC’), or computing device that includes discrete components such as a central processing unit, computer memory, and various adapters.
  • Each storage array controller ( 106 , 112 ) may include, for example, a data communications adapter configured to support communications via the SAN ( 158 ) and the LAN ( 160 ). Although only one of the storage array controllers ( 112 ) in the example of FIG.
  • Each storage array controller ( 106 , 112 ) may also include, for example, an I/O controller or the like that couples the storage array controller ( 106 , 112 ) for data communications, through a midplane ( 114 ), to a number of storage devices ( 146 , 150 ), and a number of NVRAM devices ( 148 , 152 ).
  • Each NVRAM device ( 148 , 152 ) may be configured to receive, from the storage array controller ( 106 , 112 ), data to be stored in the storage devices ( 146 ). Such data may originate from any one of the computing devices ( 164 , 166 , 168 , 170 ). In the example of FIG. 1 , writing data to the NVRAM device may be carried out more quickly than writing data to the storage device.
  • the storage array controller ( 106 , 112 ) may be configured to effectively utilize the NVRAM devices ( 148 , 152 ) as a quickly accessible buffer for data destined to be written to the storage devices ( 146 , 150 ). In this way, the latency of write requests may be significantly improved relative to a system in which the storage array controller writes data directly to the storage devices ( 146 , 150 ).
  • the NVRAM devices may be implemented with computer memory in the form of high bandwidth, low latency DRAM.
  • each NVRAM device is referred to as ‘non-volatile’ because each NVRAM device may receive or include a unique power source that maintains the state of the DRAM after main power loss to the NVRAM device ( 148 , 152 ).
  • a power source may be a battery, one or more capacitors, or the like.
  • the NVRAM device ( 148 , 152 ) may be configured to write the contents of the DRAM to a persistent storage, such as flash memory contained within the NVRAM device ( 148 , 152 ).
  • flash memory that is contained within the NVRAM device ( 148 , 152 ) may be embodied, for example, as one or more non-volatile dual-inline memory modules (‘NVDIMMs’).
  • a ‘storage device’ as the term is used in this specification refers to any device configured to record data persistently.
  • the term ‘persistently’ as used here refers to a device's ability to maintain recorded data after loss of a power source. Examples of storage devices may include mechanical, spinning hard disk drives, solid-state drives (“Flash drives”), and the like.
  • each of the storage devices ( 146 , 150 ) may be configured to expose its geometry to one or more of the storage array controllers ( 106 , 112 ) by sending information describing the layout of memory in the storage device ( 146 , 150 ), receiving a write request associated with an amount of data sized in dependence upon the layout of memory in the storage device ( 146 , 150 ), and writing the data to a location within the memory unit in dependence upon the layout of memory in the storage device ( 146 , 150 ), as described in greater detail below.
  • sending information describing the layout of memory in the storage device ( 146 , 150 ), receiving a write request associated with an amount of data sized in dependence upon the layout of memory in the storage device ( 146 , 150 ), and writing the data to a location within the memory unit in dependence upon the layout of memory in the storage device ( 146 , 150 ) may be carried out, for example, by an embedded microcontroller or other digital circuitry included in the storage device ( 146 , 150 ).
  • the storage array controllers ( 106 , 112 ) of FIG. 1 may be useful for aligning memory access operations to a geometry of a storage device ( 146 , 150 ) according to embodiments of the present disclosure.
  • the storage array controllers ( 106 , 112 ) may be useful for aligning memory access operations to a geometry of a storage device ( 146 , 150 ) by receiving information describing the layout of memory in the storage device ( 146 , 150 ), determining a write size in dependence upon the layout of memory in the storage device ( 146 , 150 ), and sending a write request addressed to a location within the memory unit in dependence upon the layout of memory in the storage device ( 146 , 150 ), as will be described in greater detail below.
  • FIG. 1 The arrangement of computing devices, storage arrays, networks, and other devices making up the example system illustrated in FIG. 1 are for explanation, not for limitation.
  • Systems useful according to various embodiments of the present disclosure may include different configurations of servers, routers, switches, computing devices, and network architectures, not shown in FIG. 1 , as will occur to those of skill in the art.
  • Exposing a geometry of a storage device in accordance with embodiments of the present disclosure is generally implemented with computers.
  • all the computing devices ( 164 , 166 , 168 , 170 ) and storage controllers ( 106 , 112 ) may be implemented, to some extent at least, as computers.
  • FIG. 2 therefore sets forth a block diagram of a storage array controller ( 202 ) useful for exposing a geometry of a storage device according to embodiments of the present disclosure.
  • the storage array controller ( 202 ) of FIG. 2 is similar to the storage array controllers depicted in FIG. 1 .
  • the storage array controller ( 202 ) of FIG. 2 is also communicatively coupled, via a midplane ( 206 ), to one or more storage devices ( 212 ) and also to one or more NVRAM devices ( 214 ) that are included as part of a storage array ( 216 ).
  • the storage array controller ( 202 ) may be coupled to the midplane ( 206 ) via one or more data communications links ( 204 ) and the midplane ( 206 ) may be coupled to the storage devices ( 212 ) and the NVRAM devices ( 214 ) via one or more data communications links ( 208 , 210 ).
  • the data communications links ( 204 , 208 , 210 ) of FIG. 2 may be embodied, for example, as Peripheral Component Interconnect Express (‘PCIe’) bus.
  • PCIe Peripheral Component Interconnect
  • the storage array controller ( 202 ) of FIG. 2 includes at least one computer processor ( 232 ) or ‘CPU’ as well as RAM ( 236 ).
  • the computer processor ( 232 ) may be connected to the RAM ( 236 ) via a data communications link ( 230 ), which may be embodied as a high speed memory bus such as a Double-Data Rate 4 (‘DDR4’) bus.
  • DDR4 Double-Data Rate 4
  • RAM ( 214 ) Stored in RAM ( 214 ) is an operating system ( 246 ).
  • Examples of operating systems useful in storage array controllers ( 202 ) configured for buffering data to be written to an array of non-volatile storage devices according to embodiments of the present disclosure include UNIXTM, LinuxTM, Microsoft WindowsTM, and others as will occur to those of skill in the art.
  • the operating system ( 246 ) in the example of FIG. 2 is shown in RAM ( 168 ), but many components of such software may be stored in non-volatile memory such as a disk drive, an SSD, and so on.
  • an alignment module 250
  • the geometry of the storage device may be defined by various characteristics of the storage device such as, for example, the size of various memory units such as a page, a block, and so on.
  • the geometry of the storage device may be such that a page is 16 KB in size and that a block includes 512 pages, such that the total block size is 8 MB.
  • the alignment module ( 250 ) may be configured for aligning memory access operations to a geometry of a storage device by receiving information describing the layout of memory in the storage device.
  • the storage array controller ( 202 ) may receive the information describing the layout of memory in the storage device, for example, via a midplane and one or more data communications links as described above with reference to FIG. 1 .
  • Such information can include information describing the size of various memory units such as a page, a block, or other memory unit within the storage device.
  • the information can also include, for example, information describing the number of blocks in the storage device, information describing any pages or blocks that are reserved for a specific purpose (e.g., storing boot code for a device) and are therefore unavailable for general purpose use, and any other information useful in describing the layout of memory in the storage device.
  • information describing the number of blocks in the storage device information describing any pages or blocks that are reserved for a specific purpose (e.g., storing boot code for a device) and are therefore unavailable for general purpose use, and any other information useful in describing the layout of memory in the storage device.
  • the alignment module ( 250 ) may be configured for aligning memory access operations to a geometry of a storage device by determining a write size in dependence upon the layout of memory in the storage device.
  • the storage array controller ( 202 ) may determine a write size in dependence upon the layout of memory in the storage device, for example, by examining the information describing the layout of memory in the storage device to identify the smallest writeable memory unit in the storage device.
  • the smallest writeable memory unit in the storage device may be embodied, for example, as the smallest unit within a storage device that may be written to when executing a single write operation.
  • the smallest writeable memory unit in the storage device may be embodied as a 16 KB page. In the example method depicted in FIG.
  • the size of a writeable memory unit in the storage device may be different than the size of an erasable memory unit in the storage device.
  • a single write operation may write data to a single 16 KB page while a single erase operation may only erase memory as a single 8 MB block.
  • the storage array controller ( 202 ) may be configured such that when the storage array controller ( 202 ) receives a request to write data in excess of 16 KB from a computing device ( 164 , 166 , 168 , 170 of FIG. 1 ) that has access to the storage array ( 102 , 104 of FIG. 1 ), the storage array controller ( 202 ) can break up the data into multiple, non-overlapping 16 KB units. In such a way, the storage array controller ( 202 ) may service a request to write data in excess of 16 KB by issuing a distinct write request to write each of the 16 KB unit to a different page of the storage device.
  • the alignment module ( 250 ) may be configured for aligning memory access operations to a geometry of a storage device by sending, to the storage device, a write request addressed to a location within a memory unit in dependence upon the layout of memory in the storage device.
  • the storage array controller ( 202 ) of FIG. 2 may be configured, for example, to write data to unused portions of a first erasable memory unit until the first erasable memory unit contains no unused portions. Once the first erasable memory unit contains no unused portions, the storage array controller ( 202 ) may be configured to identify a second erasable memory unit and write data to unused portions of the second erasable memory unit until the second erasable memory unit contains no unused portions.
  • sending a write request addressed to a location within the memory unit in dependence upon the layout of memory in the storage device may be carried out by the storage array controller ( 202 ) receiving information describing the size of a single erasable memory unit and the storage array controller ( 202 ) tracking which portions of the single erasable memory unit data has been written to, as well as tracking which portions of the single erasable memory unit are unused.
  • the storage array controller ( 202 ) may be configured to issue write requests to contiguous unused portions a single erasable memory unit, until data has been written to all portions of the single erasable memory unit.
  • the storage array controller ( 202 ) may be configured to issue requests to write data to contiguous locations (e.g., pages) within a particular 8 MB block until the block includes no unused portions.
  • the storage array controller ( 202 ) may be configured to issue requests to write data to contiguous locations within a new 8 MB block until the new block includes no unused portions.
  • data may be written to unused portions of a multiple erasable memory units in parallel.
  • the storage array controller ( 202 ) of FIG. 2 may be configured to write data to an unused portion of a first erasable memory unit, an unused portion of a second erasable memory unit, an unused portion of a third erasable memory unit, and so on in parallel.
  • the storage array controller ( 202 ) of FIG. 2 may have a predetermined set of memory units that may be utilized in parallel, such that the storage array controller ( 202 ) may be writing data to each memory unit in the set simultaneously.
  • the storage array controller ( 202 ) may be configured to issue a request to write data to contiguous locations (e.g., pages) within each of the one hundred 8 MB blocks in parallel.
  • the storage array controller ( 202 ) may be configured to simultaneously issue a request to write the first 16 KB of the data to a first unused page in the first 8 MB block, issue a request to write the second 16 KB of the data to a first unused page in the second 8 MB block, issue a request to write the third 16 KB of the data to a first unused page in the third 8 MB block, and so on.
  • the storage array controller ( 202 ) achieve performance benefits by writing to multiple blocks in parallel, rather than writing only to a single block.
  • the storage array controller ( 202 ) of FIG. 2 also includes a plurality of host bus adapters ( 218 , 220 , 222 ) that are coupled to the processor ( 232 ) via a data communications link ( 224 , 226 , 228 ).
  • Each host bus adapter ( 218 , 220 , 222 ) may be embodied as a module of computer hardware that connects the host system (i.e., the storage array controller) to other network and storage devices.
  • Each host bus adapter ( 218 , 220 , 222 ) may be coupled to the computer processor ( 232 ) via a data communications link ( 224 , 226 , 228 ) such as, for example, a PCIe bus.
  • the storage array controller ( 202 ) of FIG. 2 also includes a switch ( 244 ) that is coupled to the computer processor ( 232 ) via a data communications link ( 238 ).
  • the switch ( 244 ) of FIG. 2 may be embodied as a computer hardware device that can create multiple ports out of a single port, thereby enabling multiple devices to share what was initially a single port.
  • the switch ( 244 ) of FIG. 2 may be embodied, for example, as a PCIe switch that is coupled to a PCIe bus ( 238 ) and presents multiple PCIe connection points to the midplane ( 206 ).
  • the storage array controller ( 202 ) of FIG. 2 also includes a host bus adapter ( 240 ) that is coupled to an expander ( 242 ).
  • the expander ( 242 ) depicted in FIG. 2 may be embodied, for example, as a module of computer hardware utilized to attach a host system to a larger number of storage devices than would be possible without the expander ( 242 ).
  • the expander ( 242 ) depicted in FIG. 2 may be embodied, for example, as a SAS expander utilized to enable the host bus adapter ( 240 ) to attach to storage devices in an embodiment where the host bus adapter ( 240 ) is embodied as a SAS controller.
  • the combination of a host bus adapter ( 240 ) and expander ( 242 ) may be replaced by a PCIe switch as described in the preceding paragraph.
  • the storage array controller ( 202 ) of FIG. 2 also includes a data communications link ( 234 ) for coupling the storage array controller ( 202 ) to other storage array controllers.
  • a data communications link ( 234 ) may be embodied, for example, as a PCIe Non-Transparent Bridge (‘NTB’), a QuickPath Interconnect (‘QPI’) interconnect, and so on. Readers will appreciate, however, that such a data communications link ( 234 ) may be embodied using other interconnects and protocols in accordance with embodiments described herein.
  • FIG. 3 sets forth a block diagram of a storage device ( 302 ) according to embodiments of the present disclosure.
  • the example storage device ( 302 ) depicted in FIG. 3 includes a plurality of memory blocks ( 304 , 316 , 318 , 320 ), each of which include a plurality of pages ( 306 , 308 , 310 , 312 , 314 ).
  • Each page ( 306 , 308 , 310 , 312 , 314 ) may be of a predetermined size such as, for example, 16 KB.
  • each page ( 306 , 308 , 310 , 312 , 314 ) may represent the unit of memory that can be used to service a single write operation.
  • Each block ( 304 , 316 , 318 , 320 ) may be of a predetermined size such as, for example, 8 MB.
  • Each block ( 304 , 316 , 318 , 320 ) may therefore include a predetermined number of pages ( 306 , 308 , 310 , 312 , 314 ).
  • each block ( 304 , 316 , 318 , 320 ) may represent the unit of memory that is erased by executing a single erase operation.
  • a single erase operation may erase all 8 MB of a particular block ( 304 , 316 , 318 , 320 ).
  • the amount of data written by performing a single write operation is therefore different than the amount of data erased by performing a single erase operation.
  • FIG. 4 sets forth a flow chart illustrating an example method of aligning memory access operations to a geometry of a storage device ( 402 ) according to embodiments of the present disclosure.
  • the geometry of the storage device ( 402 ) may be defined by various characteristics of the storage device ( 402 ) such as, for example, the size of various memory units ( 424 , 426 , 428 , 430 ) such as a page, a block, and so on.
  • the geometry of the storage device ( 402 ) may be such that a page is 16 KB in size and that a block includes 512 pages, such that the total block size is 8 MB.
  • the example method depicted in FIG. 4 includes sending ( 404 ), by the storage device ( 402 ), information ( 410 ) describing the layout of memory in the storage device ( 402 ).
  • the storage device ( 402 ) may send ( 404 ) information ( 410 ) describing the layout of memory in the storage device ( 402 ), for example, to a storage array controller ( 412 ) via a midplane and one or more data communications links as described above with reference to FIG. 1 .
  • Such information ( 410 ) can include information describing the size of various memory units ( 424 , 426 , 428 , 430 ) such as a page, a block, or other memory unit ( 424 , 426 , 428 , 430 ) within the storage device ( 402 ).
  • the information ( 410 ) can also include, for example, information describing the number of blocks in the storage device ( 402 ), information describing any pages or blocks that are reserved for a specific purpose (e.g., storing boot code for a device) and are therefore unavailable for general purpose use, and any other information useful in describing the layout of memory in the storage device ( 402 ).
  • the information ( 410 ) describing the layout of memory in the storage device ( 402 ) may be sent ( 404 ) from the storage device ( 402 ) via one or more messages that may include information such as an identifier of the storage device ( 402 ), the layout information ( 410 ) itself, and any other necessary information.
  • the information ( 410 ) describing the layout of memory in the storage device ( 402 ) may be sent ( 404 ) by the storage device ( 402 ) in response to a request for such information ( 410 ), periodically upon the expiration of a predetermined period of time, in response to an indication that the storage array controller ( 412 ) is booting up, or in response to any other triggering event.
  • the example method depicted in FIG. 4 also includes receiving ( 418 ), by the storage array controller ( 412 ), the information ( 410 ) describing the layout of memory in the storage device ( 402 ).
  • the storage array controller ( 412 ) may receive ( 418 ) the information ( 410 ) describing the layout of memory in the storage device ( 402 ), for example, via a midplane and one or more data communications links as described above with reference to FIG. 1 .
  • the information ( 410 ) describing the layout of memory in the storage device ( 402 ) may be received ( 418 ) via one or more messages that may include information such as an identifier of the storage device ( 402 ), the layout information ( 410 ) itself, and any other information useful in describing the layout of memory in the storage device ( 402 ).
  • the example method depicted in FIG. 4 also includes determining ( 420 ), by the storage array controller ( 412 ), a write size in dependence upon the layout of memory in the storage device ( 402 ).
  • the storage array controller ( 412 ) may determine ( 420 ) a write size in dependence upon the layout of memory in the storage device ( 402 ), for example, by examining the information ( 410 ) describing the layout of memory in the storage device ( 402 ) to identify the smallest writeable memory unit in the storage device ( 402 ).
  • the smallest writeable memory unit in the storage device ( 402 ) may be embodied, for example, as the smallest unit within a storage device ( 402 ) that may be written to when executing a single write operation.
  • the smallest writeable memory unit in the storage device ( 402 ) may be embodied as a 16 KB page.
  • the size of a writeable memory unit in the storage device ( 402 ) may be different than the size of an erasable memory unit in the storage device ( 402 ).
  • a single write operation may write data to a single 16 KB page while a single erase operation may only erase memory as a single 8 MB block.
  • the storage array controller ( 412 ) may be configured such that when the storage array controller ( 412 ) receives a request to write data in excess of 16 KB from a computing device ( 164 , 166 , 168 , 170 of FIG.
  • the storage array controller ( 412 ) can break up the data into multiple, non-overlapping 16 KB units. In such a way, the storage array controller ( 412 ) may service a request to write data in excess of 16 KB by issuing a distinct write request to write each of the 16 KB units to a different page of the storage device ( 402 ).
  • the example method depicted in FIG. 4 also includes sending ( 422 ), from the storage array controller ( 412 ) to the storage device ( 402 ), a write request ( 414 ) addressed to a location within a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ).
  • the storage array controller ( 412 ) of FIG. 4 may be configured, for example, to issue write requests directed to unused portions of a first erasable memory unit until the first erasable memory unit contains no unused portions.
  • the storage array controller ( 412 ) may be configured to identify a second erasable memory unit and issue write requests directed to unused portions of the second erasable memory unit until the second erasable memory unit contains no unused portions.
  • sending ( 422 ) a write request ( 414 ) addressed to a location within the memory unit in dependence upon the layout of memory in the storage device ( 402 ) may be carried out by the storage array controller ( 412 ) receiving information describing the size of a single erasable memory unit and the storage array controller ( 412 ) tracking which portions of the single erasable memory unit data has been written to, as well as tracking which portions of the single erasable memory unit are unused.
  • the storage array controller ( 412 ) may be configured to issue write requests to contiguous unused portions a single erasable memory unit, until data has been written to all portions of the single erasable memory unit.
  • the storage array controller ( 412 ) may be configured to issue requests to write data to contiguous locations within a particular 8 MB block until the block includes no unused portions.
  • the storage array controller ( 412 ) may be configured to issue requests to write data to contiguous locations within a new 8 MB block until the new block includes no unused portions.
  • the example method depicted in FIG. 4 also includes receiving ( 406 ), by the storage device ( 402 ), the write request ( 414 ).
  • the write request ( 414 ) may be received ( 406 ) by the storage device ( 402 ), for example, from the storage array controller ( 412 ) via a midplane and one or more data communications links as described above with reference to FIG. 1 .
  • the write request ( 414 ) is associated with an amount of data ( 416 ) that is sized in dependence upon the layout of memory in the storage device ( 402 ).
  • the write request ( 414 ) may include a request to write an amount of data ( 416 ) of a size that is selected in dependence upon the layout of memory in the storage device ( 402 ).
  • the write request ( 414 ) received ( 406 ) by the storage device ( 402 ) may include a request to write 16 KB of data to the storage device ( 402 ).
  • the example method depicted in FIG. 4 also includes writing ( 408 ), by the storage device ( 402 ), the data ( 416 ) to a memory unit ( 424 , 426 , 428 , 430 ).
  • Each memory unit ( 424 , 426 , 428 , 430 ) may be embodied, for example, as a page in the storage device ( 402 ), as a block in the storage device ( 402 ), and so on.
  • the data ( 416 ) is written ( 408 ) to a location within the memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ).
  • Such a location within the memory unit ( 424 , 426 , 428 , 430 ) may be selected by the storage array controller ( 412 ) in dependence upon the layout of memory in the storage device ( 402 ), and included in the write request ( 414 ) received by the storage device ( 402 ).
  • FIG. 5 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device ( 402 ) according to embodiments of the present disclosure.
  • the example method depicted in FIG. 5 is similar to the example method depicted in FIG. 4 , as the example method depicted in FIG.
  • FIG. 5 also includes sending ( 404 ) information ( 410 ) describing the layout of memory in the storage device ( 402 ), receiving ( 418 ) the information ( 410 ) describing the layout of memory in the storage device ( 402 ), determining ( 420 ) a write size in dependence upon the layout of memory in the storage device ( 402 ), sending ( 422 ) a write request ( 414 ) addressed to a location within a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ), receiving ( 406 ) the write request ( 414 ), and writing ( 408 ) the data ( 416 ) to a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ).
  • the write request ( 414 ) includes a physical address ( 506 ) of a location in the storage device ( 402 ) for storing the data.
  • the physical address ( 506 ) of FIG. 5 may be embodied, for example, a value that refers to a particular memory location in the storage device ( 402 ) for the entire life of the storage device ( 402 ).
  • the physical address ( 506 ) of FIG. 5 is distinguished from a virtual address, as a particular physical address ( 506 ) will always refer to the same memory location during the life of the storage device ( 402 ) and no translation of the particular physical address ( 506 ) is required to identify the particular memory location associated with the particular physical address ( 506 ).
  • the storage array controller ( 412 ) may be able to include the physical address ( 506 ) in the write request ( 414 ), for example, by receiving information describing a physical addressing scheme in the information ( 410 ) describing the layout of memory in the storage device ( 402 ) and maintaining a page table or other data structure for performing address translation.
  • the storage array controller ( 412 ) can be configured to send memory access requests (e.g., read, write, erase) to the storage device ( 402 ), without requiring the storage device ( 402 ) to perform address translation operations in order to service the memory access requests.
  • the information ( 410 ) describing the layout of memory in the storage device ( 402 ) includes information ( 502 ) describing a size of a writeable memory unit in the storage device ( 402 ).
  • the writeable memory unit in the storage device ( 402 ) may be embodied, for example, as the smallest unit within a storage device ( 402 ) that data may be written to when executing a single write operation.
  • the smallest writeable memory unit in the storage device ( 402 ) may be embodied as a 16 KB page, such that two write operations cannot be directed to the same 16 KB page without overwriting (via an erase and program cycle) data written to the 16 KB page by the first write operation.
  • the information ( 410 ) describing the layout of memory in the storage device ( 402 ) includes information ( 504 ) describing a size of an erasable memory unit in the storage device ( 402 ).
  • the erasable memory unit in the storage device ( 402 ) may be embodied, for example, as the smallest unit within a storage device ( 402 ) that is erased when executing a single erase operation.
  • the erasable memory unit may be embodied as an 8 MB block. In such an example, when a single erase command is executed, the entire 8 MB block is erased and all data stored in the 8 MB block is lost, unless such data is rewritten elsewhere prior to executing the erase command.
  • writing ( 408 ) the data ( 416 ) to a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ) can alternatively include writing ( 508 ) the data to an unused portion of the memory unit ( 424 , 426 , 428 , 430 ).
  • the unused portions of the memory unit ( 424 , 426 , 428 , 430 ) may be embodied, for example, as empty pages within a block. For example, an 8 MB block may only include data stored in the pages that comprise the first 3 MB of the block, meaning that no data is stored in the pages that comprise the last 5 MB of the block.
  • writing ( 508 ) the data to an unused portion of the memory unit ( 424 , 426 , 428 , 430 ) may therefore be carried out by writing data to some portion of the pages that comprise the last 5 MB of the block.
  • writing ( 408 ) the data ( 416 ) to a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ) can alternatively include writing ( 510 ) the data to an unused memory unit ( 424 , 426 , 428 , 430 ).
  • the unused memory unit ( 424 , 426 , 428 , 430 ) may be embodied, for example, as an entire empty block. For example, an 8 MB block may have been recently subjected to an erase operation, meaning that no data is stored in the entire 8 MB block.
  • writing ( 510 ) the data to an unused memory unit ( 424 , 426 , 428 , 430 ) may therefore be carried out by writing data to one or more pages within the block.
  • FIG. 6 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device ( 402 ) according to embodiments of the present disclosure.
  • the example method depicted in FIG. 6 is similar to the example method depicted in FIG. 4 , as the example method depicted in FIG.
  • FIG. 6 also includes sending ( 404 ) information ( 410 ) describing the layout of memory in the storage device ( 402 ), receiving ( 418 ) the information ( 410 ) describing the layout of memory in the storage device ( 402 ), determining ( 420 ) a write size in dependence upon the layout of memory in the storage device ( 402 ), sending ( 422 ) a write request ( 414 ) addressed to a location within a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ), receiving ( 406 ) the write request ( 414 ), and writing ( 408 ) the data ( 416 ) to a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ).
  • the example method depicted in FIG. 6 also includes sending ( 602 ), by the storage array controller ( 412 ), a request ( 604 ) to expose an underlying physical layout of the memory in the storage device ( 402 ).
  • the request ( 604 ) to expose the underlying physical layout of the memory in the storage device ( 402 ) may be sent ( 602 ) from the storage array controller ( 412 ) to the storage device ( 402 ) via a midplane and one or more data communications links as described above with reference to FIG. 1 .
  • the storage array controller ( 412 ) may send ( 602 ) the request ( 604 ) to the storage device ( 402 ), for example, when the storage array controller ( 412 ) is booted, in response to detecting that the storage device ( 402 ) has been powered up or otherwise added to the storage array, and so on.
  • FIG. 7 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device ( 402 ) according to embodiments of the present disclosure.
  • the example method depicted in FIG. 7 is similar to the example method depicted in FIG. 4 , as the example method depicted in FIG.
  • FIG. 7 also includes sending ( 404 ) information ( 410 ) describing the layout of memory in the storage device ( 402 ), receiving ( 418 ) the information ( 410 ) describing the layout of memory in the storage device ( 402 ), determining ( 420 ) a write size in dependence upon the layout of memory in the storage device ( 402 ), sending ( 422 ) a write request ( 414 ) addressed to a location within a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ), receiving ( 406 ) the write request ( 414 ), and writing ( 408 ) the data ( 416 ) to a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ).
  • sending ( 422 ) a write request ( 414 ) addressed to a location within a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ) can include identifying ( 702 ) an unused portion of the memory unit ( 424 , 426 , 428 , 430 ).
  • the unused portions of the memory unit ( 424 , 426 , 428 , 430 ) may be embodied, for example, as empty pages within a block.
  • an 8 MB block may only include data stored in the pages that comprise the first 3 MB of the block, meaning that no data is stored in the pages that comprise the last 5 MB of the block.
  • writing ( 508 ) the data to an unused portion of the memory unit ( 424 , 426 , 428 , 430 ) may therefore be carried out by writing data to some portion of the pages that comprise the last 5 MB of the block.
  • the storage array controller ( 412 ) of FIG. 7 may identify ( 702 ) the unused portion of the memory unit ( 424 , 426 , 428 , 430 ), for example, by tracking which portions of the memory unit ( 424 , 426 , 428 , 430 ) have been written to since the last time that the memory unit ( 424 , 426 , 428 , 430 ) was erased.
  • the storage array controller ( 412 ) may be configured to direct write requests to contiguous portions of a memory unit ( 424 , 426 , 428 , 430 ) until all portions of the memory unit ( 424 , 426 , 428 , 430 ) have been written to since the last time that the memory unit ( 424 , 426 , 428 , 430 ) was erased.
  • the storage array controller ( 412 ) may direct a first write request to a first portion (e.g., a first page) of the particular memory unit ( 424 , 426 , 428 , 430 ), the storage array controller ( 412 ) may direct a second write request to a second portion (e.g., a second page) of the particular memory unit ( 424 , 426 , 428 , 430 ), and so on.
  • a first portion e.g., a first page
  • the storage array controller ( 412 ) may direct a second write request to a second portion (e.g., a second page) of the particular memory unit ( 424 , 426 , 428 , 430 ), and so on.
  • sending ( 422 ) a write request ( 414 ) addressed to a location within a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ) can also include including ( 704 ) an address for the unused portion of the memory unit ( 424 , 426 , 428 , 430 ) in the write request ( 414 ).
  • the address for the unused portion of the memory unit ( 424 , 426 , 428 , 430 ) in the write request ( 414 ) may be embodied, for example, as a logical address that is to be translated by the storage device ( 402 ) or, alternatively, as a physical address that requires no translation by the storage device ( 402 ).
  • sending ( 422 ) a write request ( 414 ) addressed to a location within a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ) can alternatively include identifying ( 706 ) an unused memory unit ( 424 , 426 , 428 , 430 ).
  • the unused memory unit ( 424 , 426 , 428 , 430 ) may be embodied, for example, as an entire empty block. For example, an 8 MB block may have been recently subjected to an erase operation, meaning that no data is stored in the entire 8 MB block.
  • writing ( 510 ) the data to an unused memory unit ( 424 , 426 , 428 , 430 ) may therefore be carried out by writing data to one or more pages within the block.
  • the storage array controller ( 412 ) of FIG. 7 may identify ( 706 ) the unused memory unit ( 424 , 426 , 428 , 430 ), for example, by tracking which memory units ( 424 , 426 , 428 , 430 ) have been written to since the last time that each memory unit ( 424 , 426 , 428 , 430 ) was erased.
  • the storage array controller ( 412 ) may be configured to direct write requests to contiguous portions of a memory unit ( 424 , 426 , 428 , 430 ) until all portions of the memory unit ( 424 , 426 , 428 , 430 ) have been written to since the last time that the memory unit ( 424 , 426 , 428 , 430 ) was erased.
  • the storage array controller ( 412 ) may direct a first write request to a first portion (e.g., a first page) of the particular memory unit ( 424 , 426 , 428 , 430 ), the storage array controller ( 412 ) may direct a second write request to a second portion (e.g., a second page) of the particular memory unit ( 424 , 426 , 428 , 430 ), and so on.
  • a first portion e.g., a first page
  • the storage array controller ( 412 ) may direct a second write request to a second portion (e.g., a second page) of the particular memory unit ( 424 , 426 , 428 , 430 ), and so on.
  • the storage array controller ( 412 ) may identify an entirely unused memory unit ( 424 , 426 , 428 , 430 ) and begin directing write requests to the entirely unused memory unit ( 424 , 426 , 428 , 430 ).
  • sending ( 422 ) a write request ( 414 ) addressed to a location within a memory unit ( 424 , 426 , 428 , 430 ) in dependence upon the layout of memory in the storage device ( 402 ) can also include including ( 708 ) an address for the unused memory unit ( 424 , 426 , 428 , 430 ) in the write request ( 414 ).
  • the address for the unused memory unit ( 424 , 426 , 428 , 430 ) in the write request ( 414 ) may be embodied, for example, as a logical address that is to be translated by the storage device ( 402 ) or, alternatively, as a physical address that requires no translation by the storage device ( 402 ).
  • Example embodiments of the present disclosure are described largely in the context of a fully functional computer system. Readers of skill in the art will recognize, however, that the present disclosure also may be embodied in a computer program product disposed upon computer readable media for use with any suitable data processing system.
  • Such computer readable storage media may be any transitory or non-transitory media. Examples of such media include storage media for machine-readable information, including magnetic media, optical media, or other suitable media. Examples of such media also include magnetic disks in hard drives or diskettes, compact disks for optical drives, magnetic tape, and others as will occur to those of skill in the art. Persons skilled in the art will immediately recognize that any computer system having suitable programming means will be capable of executing the steps of the method of the invention as embodied in a computer program product.

Abstract

A write size is determined based on information describing a layout of memory in a storage device operatively coupled to the storage array controller. A write request to store data at a location of the storage device is sent, wherein the write request is associated with the determined write size and wherein the write request includes a physical address of the location in the storage device to store the data.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 16/746,461, filed Jan. 17, 2020, which is a continuation of U.S. patent application Ser. No. 16/261,895, filed Jan. 30, 2019, now U.S. Pat. No. 10,564,882, issued Feb. 18, 2020, which is a continuation of U.S. patent application Ser. No. 15/390,123, filed Dec. 23, 2016, issued on Feb. 26, 2019 as U.S. Pat. No. 10,216,447, which is a continuation of U.S. patent application Ser. No. 14/747,842, filed Jun. 23, 2015, issued on Jan. 17, 2017 as U.S. Pat. No. 9,547,441, which are hereby incorporated by reference.
  • BACKGROUND Field of Technology
  • The field of technology is methods, apparatuses, and products for exposing a geometry of a storage device.
  • Description of Related Art
  • Enterprise storage systems can provide large amounts of computer storage to modern enterprises. The performance of such storage systems, which is frequently measured in terms of throughput and latency, may be reduced as the storage devices may be required to perform operations other than servicing input/output (‘I/O’) operations.
  • SUMMARY
  • Methods, apparatus, and products for exposing a geometry of a storage device, including: sending, by the storage device, information describing the layout of memory in the storage device; receiving, by the storage device, a write request, the write request associated with an amount of data sized in dependence upon the layout of memory in the storage device; and writing, by the storage device, the data to a memory unit, the data written to a location within the memory unit in dependence upon the layout of memory in the storage device.
  • The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular descriptions of example embodiments of the invention as illustrated in the accompanying drawings wherein like reference numbers generally represent like parts of example embodiments of the invention.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 sets forth a block diagram of a system configured for exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 2 sets forth a block diagram of a storage array controller useful in exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 3 sets forth a block diagram of a storage device according to embodiments of the present disclosure.
  • FIG. 4 sets forth a flow chart illustrating an example method of exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 5 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 6 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device according to embodiments of the present disclosure.
  • FIG. 7 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device according to embodiments of the present disclosure.
  • DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS
  • Example methods, apparatuses, and products for exposing a geometry of a storage device in accordance with the present disclosure are described with reference to the accompanying drawings, beginning with FIG. 1. FIG. 1 sets forth a block diagram of a system configured for exposing a geometry of a storage device according to embodiments of the present disclosure. The system of FIG. 1 includes a plurality of computing devices (164, 166, 168, 170). Such computing devices may be implemented in a number of different ways. For example, a computing device may be a server in a data center, a workstation, a personal computer, a notebook, or the like.
  • The computing devices (164, 166, 168, 170) in the example of FIG. 1 are coupled for data communications to one or more storage arrays (102, 104) through a storage area network (‘SAN’) (158) as well as a local area network (160) (‘LAN’). The SAN (158) may be implemented with a variety of data communications fabrics, devices, and protocols. Example fabrics for such a SAN (158) may include Fibre Channel, Ethernet, Infiniband, Serial Attached SCSI (‘SAS’), and the like. Example data communications protocols for use in such a SAN (158) may include Advanced Technology Attachment (‘ATA’), Fibre Channel Protocol, SCSI, iSCSI, HyperSCSI, and others. Readers of skill in the art will recognize that a SAN is just one of many possible data communications couplings which may be implemented between a computing device (164, 166, 168, 170) and a storage array (102, 104), and readers will further appreciate that any other data communications coupling is well within the scope of embodiments of the present disclosure.
  • The local area network (160) of FIG. 1 may also be implemented with a variety of fabrics and protocols. Examples of such fabrics include Ethernet (802.3), wireless (802.11), and the like. Examples of such data communications protocols include Transmission Control Protocol (‘TCP’), User Datagram Protocol (‘UDP’), Internet Protocol (‘IP’), HyperText Transfer Protocol (‘HTTP’), Wireless Access Protocol (‘WAP’), Handheld Device Transport Protocol (‘HDTP’), Session Initiation Protocol (‘SIP’), Real Time Protocol (‘RTP’), and so on.
  • The example storage arrays (102, 104) of FIG. 1 provide persistent data storage for the computing devices (164, 166, 168, 170). Each storage array (102, 104) depicted in FIG. 1 includes one or more storage array controllers (106, 112). Each storage array controller (106, 112) may be embodied as a module of automated computing machinery comprising computer hardware, computer software, or a combination of computer hardware and software. The storage array controllers (106, 112) may be configured to carry out various storage-related tasks. Such tasks may include writing data received from the one or more of the computing devices (164, 166, 168, 170) to storage, erasing data from storage, retrieving data from storage to provide the data to one or more of the computing devices (164, 166, 168, 170), monitoring and reporting of disk utilization and performance, performing Redundant Array of Independent Drives (‘RAID’) or RAID-like data redundancy operations, compressing data, encrypting data, and so on.
  • Each storage array controller (106, 112) may be implemented in a variety of ways, including as an Field Programmable Gate Array (‘FPGA’), a Programmable Logic Chip (‘PLC’), an Application Specific Integrated Circuit (‘ASIC’), or computing device that includes discrete components such as a central processing unit, computer memory, and various adapters. Each storage array controller (106, 112) may include, for example, a data communications adapter configured to support communications via the SAN (158) and the LAN (160). Although only one of the storage array controllers (112) in the example of FIG. 1 is depicted as being coupled to the LAN (160) for data communications, readers will appreciate that both storage array controllers (106, 112) may be independently coupled to the LAN (160). Each storage array controller (106, 112) may also include, for example, an I/O controller or the like that couples the storage array controller (106, 112) for data communications, through a midplane (114), to a number of storage devices (146, 150), and a number of NVRAM devices (148, 152).
  • Each NVRAM device (148, 152) may be configured to receive, from the storage array controller (106, 112), data to be stored in the storage devices (146). Such data may originate from any one of the computing devices (164, 166, 168, 170). In the example of FIG. 1, writing data to the NVRAM device may be carried out more quickly than writing data to the storage device. The storage array controller (106, 112) may be configured to effectively utilize the NVRAM devices (148, 152) as a quickly accessible buffer for data destined to be written to the storage devices (146, 150). In this way, the latency of write requests may be significantly improved relative to a system in which the storage array controller writes data directly to the storage devices (146, 150).
  • The NVRAM devices may be implemented with computer memory in the form of high bandwidth, low latency DRAM. In such an embodiment, each NVRAM device is referred to as ‘non-volatile’ because each NVRAM device may receive or include a unique power source that maintains the state of the DRAM after main power loss to the NVRAM device (148, 152). Such a power source may be a battery, one or more capacitors, or the like. During the power loss, the NVRAM device (148, 152) may be configured to write the contents of the DRAM to a persistent storage, such as flash memory contained within the NVRAM device (148, 152). Such flash memory that is contained within the NVRAM device (148, 152) may be embodied, for example, as one or more non-volatile dual-inline memory modules (‘NVDIMMs’).
  • A ‘storage device’ as the term is used in this specification refers to any device configured to record data persistently. The term ‘persistently’ as used here refers to a device's ability to maintain recorded data after loss of a power source. Examples of storage devices may include mechanical, spinning hard disk drives, solid-state drives (“Flash drives”), and the like.
  • In the example depicted in FIG. 1, each of the storage devices (146, 150) may be configured to expose its geometry to one or more of the storage array controllers (106, 112) by sending information describing the layout of memory in the storage device (146, 150), receiving a write request associated with an amount of data sized in dependence upon the layout of memory in the storage device (146, 150), and writing the data to a location within the memory unit in dependence upon the layout of memory in the storage device (146, 150), as described in greater detail below. In the example of FIG. 1, sending information describing the layout of memory in the storage device (146, 150), receiving a write request associated with an amount of data sized in dependence upon the layout of memory in the storage device (146, 150), and writing the data to a location within the memory unit in dependence upon the layout of memory in the storage device (146, 150) may be carried out, for example, by an embedded microcontroller or other digital circuitry included in the storage device (146, 150).
  • The storage array controllers (106, 112) of FIG. 1 may be useful for aligning memory access operations to a geometry of a storage device (146, 150) according to embodiments of the present disclosure. The storage array controllers (106, 112) may be useful for aligning memory access operations to a geometry of a storage device (146, 150) by receiving information describing the layout of memory in the storage device (146, 150), determining a write size in dependence upon the layout of memory in the storage device (146, 150), and sending a write request addressed to a location within the memory unit in dependence upon the layout of memory in the storage device (146, 150), as will be described in greater detail below.
  • The arrangement of computing devices, storage arrays, networks, and other devices making up the example system illustrated in FIG. 1 are for explanation, not for limitation. Systems useful according to various embodiments of the present disclosure may include different configurations of servers, routers, switches, computing devices, and network architectures, not shown in FIG. 1, as will occur to those of skill in the art.
  • Exposing a geometry of a storage device in accordance with embodiments of the present disclosure is generally implemented with computers. In the system of FIG. 1, for example, all the computing devices (164, 166, 168, 170) and storage controllers (106, 112) may be implemented, to some extent at least, as computers. For further explanation, FIG. 2 therefore sets forth a block diagram of a storage array controller (202) useful for exposing a geometry of a storage device according to embodiments of the present disclosure.
  • The storage array controller (202) of FIG. 2 is similar to the storage array controllers depicted in FIG. 1. For example, the storage array controller (202) of FIG. 2 is also communicatively coupled, via a midplane (206), to one or more storage devices (212) and also to one or more NVRAM devices (214) that are included as part of a storage array (216). The storage array controller (202) may be coupled to the midplane (206) via one or more data communications links (204) and the midplane (206) may be coupled to the storage devices (212) and the NVRAM devices (214) via one or more data communications links (208, 210). The data communications links (204, 208, 210) of FIG. 2 may be embodied, for example, as Peripheral Component Interconnect Express (‘PCIe’) bus.
  • The storage array controller (202) of FIG. 2 includes at least one computer processor (232) or ‘CPU’ as well as RAM (236). The computer processor (232) may be connected to the RAM (236) via a data communications link (230), which may be embodied as a high speed memory bus such as a Double-Data Rate 4 (‘DDR4’) bus.
  • Stored in RAM (214) is an operating system (246). Examples of operating systems useful in storage array controllers (202) configured for buffering data to be written to an array of non-volatile storage devices according to embodiments of the present disclosure include UNIX™, Linux™, Microsoft Windows™, and others as will occur to those of skill in the art. The operating system (246) in the example of FIG. 2 is shown in RAM (168), but many components of such software may be stored in non-volatile memory such as a disk drive, an SSD, and so on.
  • Also stored in RAM (214) is an alignment module (250), a module of computer program instructions for aligning memory access operations to a geometry of a storage device according to embodiments of the present disclosure. The geometry of the storage device may be defined by various characteristics of the storage device such as, for example, the size of various memory units such as a page, a block, and so on. For example, the geometry of the storage device may be such that a page is 16 KB in size and that a block includes 512 pages, such that the total block size is 8 MB.
  • The alignment module (250) may be configured for aligning memory access operations to a geometry of a storage device by receiving information describing the layout of memory in the storage device. The storage array controller (202) may receive the information describing the layout of memory in the storage device, for example, via a midplane and one or more data communications links as described above with reference to FIG. 1. Such information can include information describing the size of various memory units such as a page, a block, or other memory unit within the storage device. The information can also include, for example, information describing the number of blocks in the storage device, information describing any pages or blocks that are reserved for a specific purpose (e.g., storing boot code for a device) and are therefore unavailable for general purpose use, and any other information useful in describing the layout of memory in the storage device.
  • The alignment module (250) may be configured for aligning memory access operations to a geometry of a storage device by determining a write size in dependence upon the layout of memory in the storage device. The storage array controller (202) may determine a write size in dependence upon the layout of memory in the storage device, for example, by examining the information describing the layout of memory in the storage device to identify the smallest writeable memory unit in the storage device. The smallest writeable memory unit in the storage device may be embodied, for example, as the smallest unit within a storage device that may be written to when executing a single write operation. For example, the smallest writeable memory unit in the storage device may be embodied as a 16 KB page. In the example method depicted in FIG. 4, the size of a writeable memory unit in the storage device may be different than the size of an erasable memory unit in the storage device. For example, a single write operation may write data to a single 16 KB page while a single erase operation may only erase memory as a single 8 MB block. In such an example, the storage array controller (202) may be configured such that when the storage array controller (202) receives a request to write data in excess of 16 KB from a computing device (164, 166, 168, 170 of FIG. 1) that has access to the storage array (102, 104 of FIG. 1), the storage array controller (202) can break up the data into multiple, non-overlapping 16 KB units. In such a way, the storage array controller (202) may service a request to write data in excess of 16 KB by issuing a distinct write request to write each of the 16 KB unit to a different page of the storage device.
  • The alignment module (250) may be configured for aligning memory access operations to a geometry of a storage device by sending, to the storage device, a write request addressed to a location within a memory unit in dependence upon the layout of memory in the storage device. The storage array controller (202) of FIG. 2 may be configured, for example, to write data to unused portions of a first erasable memory unit until the first erasable memory unit contains no unused portions. Once the first erasable memory unit contains no unused portions, the storage array controller (202) may be configured to identify a second erasable memory unit and write data to unused portions of the second erasable memory unit until the second erasable memory unit contains no unused portions. In such an example, sending a write request addressed to a location within the memory unit in dependence upon the layout of memory in the storage device may be carried out by the storage array controller (202) receiving information describing the size of a single erasable memory unit and the storage array controller (202) tracking which portions of the single erasable memory unit data has been written to, as well as tracking which portions of the single erasable memory unit are unused. In such a way, the storage array controller (202) may be configured to issue write requests to contiguous unused portions a single erasable memory unit, until data has been written to all portions of the single erasable memory unit.
  • Consider the example described above in which data may be written to the storage device as a single 16 KB page while data may only be erased from the storage device as a single 8 MB block. In such an example, the storage array controller (202) may be configured to issue requests to write data to contiguous locations (e.g., pages) within a particular 8 MB block until the block includes no unused portions. In such an example, once the particular 8 MB block includes no unused portions, the storage array controller (202) may be configured to issue requests to write data to contiguous locations within a new 8 MB block until the new block includes no unused portions.
  • Readers will appreciate that in alternative embodiments, data may be written to unused portions of a multiple erasable memory units in parallel. In such an embodiment, the storage array controller (202) of FIG. 2 may be configured to write data to an unused portion of a first erasable memory unit, an unused portion of a second erasable memory unit, an unused portion of a third erasable memory unit, and so on in parallel. The storage array controller (202) of FIG. 2 may have a predetermined set of memory units that may be utilized in parallel, such that the storage array controller (202) may be writing data to each memory unit in the set simultaneously.
  • Continuing with the example described above in which data may be written to the storage device as a single 16 KB page while data may only be erased from the storage device as a single 8 MB block, assume that one hundred 8 MB blocks are available for simultaneous use by the storage array controller (202). In such an example, the storage array controller (202) may be configured to issue a request to write data to contiguous locations (e.g., pages) within each of the one hundred 8 MB blocks in parallel. For example, if the storage array controller is attempting to write data that is one hundred pages in size, the storage array controller (202) may be configured to simultaneously issue a request to write the first 16 KB of the data to a first unused page in the first 8 MB block, issue a request to write the second 16 KB of the data to a first unused page in the second 8 MB block, issue a request to write the third 16 KB of the data to a first unused page in the third 8 MB block, and so on. In such a way, the storage array controller (202) achieve performance benefits by writing to multiple blocks in parallel, rather than writing only to a single block.
  • The storage array controller (202) of FIG. 2 also includes a plurality of host bus adapters (218, 220, 222) that are coupled to the processor (232) via a data communications link (224, 226, 228). Each host bus adapter (218, 220, 222) may be embodied as a module of computer hardware that connects the host system (i.e., the storage array controller) to other network and storage devices. Each host bus adapter (218, 220, 222) of FIG. 2 may be embodied, for example, as a Fibre Channel adapter that enables the storage array controller (202) to connect to a SAN, as an Ethernet adapter that enables the storage array controller (202) to connect to a LAN, and so on. Each host bus adapter (218, 220, 222) may be coupled to the computer processor (232) via a data communications link (224, 226, 228) such as, for example, a PCIe bus.
  • The storage array controller (202) of FIG. 2 also includes a switch (244) that is coupled to the computer processor (232) via a data communications link (238). The switch (244) of FIG. 2 may be embodied as a computer hardware device that can create multiple ports out of a single port, thereby enabling multiple devices to share what was initially a single port. The switch (244) of FIG. 2 may be embodied, for example, as a PCIe switch that is coupled to a PCIe bus (238) and presents multiple PCIe connection points to the midplane (206).
  • The storage array controller (202) of FIG. 2 also includes a host bus adapter (240) that is coupled to an expander (242). The expander (242) depicted in FIG. 2 may be embodied, for example, as a module of computer hardware utilized to attach a host system to a larger number of storage devices than would be possible without the expander (242). The expander (242) depicted in FIG. 2 may be embodied, for example, as a SAS expander utilized to enable the host bus adapter (240) to attach to storage devices in an embodiment where the host bus adapter (240) is embodied as a SAS controller. In alternative embodiment, the combination of a host bus adapter (240) and expander (242) may be replaced by a PCIe switch as described in the preceding paragraph.
  • The storage array controller (202) of FIG. 2 also includes a data communications link (234) for coupling the storage array controller (202) to other storage array controllers. Such a data communications link (234) may be embodied, for example, as a PCIe Non-Transparent Bridge (‘NTB’), a QuickPath Interconnect (‘QPI’) interconnect, and so on. Readers will appreciate, however, that such a data communications link (234) may be embodied using other interconnects and protocols in accordance with embodiments described herein.
  • Readers will recognize that these components, protocols, adapters, and architectures are for illustration only, not limitation. Such a storage array controller may be implemented in a variety of different ways, each of which is well within the scope of the present disclosure.
  • For further explanation, FIG. 3 sets forth a block diagram of a storage device (302) according to embodiments of the present disclosure. The example storage device (302) depicted in FIG. 3 includes a plurality of memory blocks (304, 316, 318, 320), each of which include a plurality of pages (306, 308, 310, 312, 314). Each page (306, 308, 310, 312, 314) may be of a predetermined size such as, for example, 16 KB. In such an example, each page (306, 308, 310, 312, 314) may represent the unit of memory that can be used to service a single write operation. That is, executing a single write operation may cause 16 KB of data (or less) to be written to a single page (306, 308, 310, 312, 314). Each block (304, 316, 318, 320) may be of a predetermined size such as, for example, 8 MB. Each block (304, 316, 318, 320) may therefore include a predetermined number of pages (306, 308, 310, 312, 314). In such an example, each block (304, 316, 318, 320) may represent the unit of memory that is erased by executing a single erase operation. That is, a single erase operation may erase all 8 MB of a particular block (304, 316, 318, 320). In such an example, the amount of data written by performing a single write operation is therefore different than the amount of data erased by performing a single erase operation.
  • For further explanation, FIG. 4 sets forth a flow chart illustrating an example method of aligning memory access operations to a geometry of a storage device (402) according to embodiments of the present disclosure. The geometry of the storage device (402) may be defined by various characteristics of the storage device (402) such as, for example, the size of various memory units (424, 426, 428, 430) such as a page, a block, and so on. For example, the geometry of the storage device (402) may be such that a page is 16 KB in size and that a block includes 512 pages, such that the total block size is 8 MB.
  • The example method depicted in FIG. 4 includes sending (404), by the storage device (402), information (410) describing the layout of memory in the storage device (402). The storage device (402) may send (404) information (410) describing the layout of memory in the storage device (402), for example, to a storage array controller (412) via a midplane and one or more data communications links as described above with reference to FIG. 1. Such information (410) can include information describing the size of various memory units (424, 426, 428, 430) such as a page, a block, or other memory unit (424, 426, 428, 430) within the storage device (402). The information (410) can also include, for example, information describing the number of blocks in the storage device (402), information describing any pages or blocks that are reserved for a specific purpose (e.g., storing boot code for a device) and are therefore unavailable for general purpose use, and any other information useful in describing the layout of memory in the storage device (402).
  • The information (410) describing the layout of memory in the storage device (402) may be sent (404) from the storage device (402) via one or more messages that may include information such as an identifier of the storage device (402), the layout information (410) itself, and any other necessary information. In the example method depicted in FIG. 4, the information (410) describing the layout of memory in the storage device (402) may be sent (404) by the storage device (402) in response to a request for such information (410), periodically upon the expiration of a predetermined period of time, in response to an indication that the storage array controller (412) is booting up, or in response to any other triggering event.
  • The example method depicted in FIG. 4 also includes receiving (418), by the storage array controller (412), the information (410) describing the layout of memory in the storage device (402). The storage array controller (412) may receive (418) the information (410) describing the layout of memory in the storage device (402), for example, via a midplane and one or more data communications links as described above with reference to FIG. 1. The information (410) describing the layout of memory in the storage device (402) may be received (418) via one or more messages that may include information such as an identifier of the storage device (402), the layout information (410) itself, and any other information useful in describing the layout of memory in the storage device (402).
  • The example method depicted in FIG. 4 also includes determining (420), by the storage array controller (412), a write size in dependence upon the layout of memory in the storage device (402). The storage array controller (412) may determine (420) a write size in dependence upon the layout of memory in the storage device (402), for example, by examining the information (410) describing the layout of memory in the storage device (402) to identify the smallest writeable memory unit in the storage device (402). The smallest writeable memory unit in the storage device (402) may be embodied, for example, as the smallest unit within a storage device (402) that may be written to when executing a single write operation. For example, the smallest writeable memory unit in the storage device (402) may be embodied as a 16 KB page. In the example method depicted in FIG. 4, the size of a writeable memory unit in the storage device (402) may be different than the size of an erasable memory unit in the storage device (402). For example, a single write operation may write data to a single 16 KB page while a single erase operation may only erase memory as a single 8 MB block. In such an example, the storage array controller (412) may be configured such that when the storage array controller (412) receives a request to write data in excess of 16 KB from a computing device (164, 166, 168, 170 of FIG. 1) that has access to the storage array (102, 104 of FIG. 1), the storage array controller (412) can break up the data into multiple, non-overlapping 16 KB units. In such a way, the storage array controller (412) may service a request to write data in excess of 16 KB by issuing a distinct write request to write each of the 16 KB units to a different page of the storage device (402).
  • The example method depicted in FIG. 4 also includes sending (422), from the storage array controller (412) to the storage device (402), a write request (414) addressed to a location within a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402). The storage array controller (412) of FIG. 4 may be configured, for example, to issue write requests directed to unused portions of a first erasable memory unit until the first erasable memory unit contains no unused portions. Once the first erasable memory unit contains no unused portions, the storage array controller (412) may be configured to identify a second erasable memory unit and issue write requests directed to unused portions of the second erasable memory unit until the second erasable memory unit contains no unused portions. In such an example, sending (422) a write request (414) addressed to a location within the memory unit in dependence upon the layout of memory in the storage device (402) may be carried out by the storage array controller (412) receiving information describing the size of a single erasable memory unit and the storage array controller (412) tracking which portions of the single erasable memory unit data has been written to, as well as tracking which portions of the single erasable memory unit are unused. In such a way, the storage array controller (412) may be configured to issue write requests to contiguous unused portions a single erasable memory unit, until data has been written to all portions of the single erasable memory unit.
  • Consider the example described above in which data may be written to the storage device (402) as a single 16 KB page while data may only be erased from the storage device (402) as a single 8 MB block. In such an example, the storage array controller (412) may be configured to issue requests to write data to contiguous locations within a particular 8 MB block until the block includes no unused portions. In such an example, once the particular 8 MB block includes no unused portions, the storage array controller (412) may be configured to issue requests to write data to contiguous locations within a new 8 MB block until the new block includes no unused portions.
  • The example method depicted in FIG. 4 also includes receiving (406), by the storage device (402), the write request (414). The write request (414) may be received (406) by the storage device (402), for example, from the storage array controller (412) via a midplane and one or more data communications links as described above with reference to FIG. 1. In the example method depicted in FIG. 4, the write request (414) is associated with an amount of data (416) that is sized in dependence upon the layout of memory in the storage device (402). That is, the write request (414) may include a request to write an amount of data (416) of a size that is selected in dependence upon the layout of memory in the storage device (402). Consider the example described above in which data may be written to the storage device (402) as a single 16 KB page while data may only be erased from the storage device (402) as a single 8 MB block. In such an example, each write request (414) received (406) by the storage device (402) may include a request to write 16 KB of data to the storage device (402).
  • The example method depicted in FIG. 4 also includes writing (408), by the storage device (402), the data (416) to a memory unit (424, 426, 428, 430). Each memory unit (424, 426, 428, 430) may be embodied, for example, as a page in the storage device (402), as a block in the storage device (402), and so on. In the example method depicted in FIG. 4, the data (416) is written (408) to a location within the memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402). Such a location within the memory unit (424, 426, 428, 430) may be selected by the storage array controller (412) in dependence upon the layout of memory in the storage device (402), and included in the write request (414) received by the storage device (402).
  • For further explanation, FIG. 5 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device (402) according to embodiments of the present disclosure. The example method depicted in FIG. 5 is similar to the example method depicted in FIG. 4, as the example method depicted in FIG. 5 also includes sending (404) information (410) describing the layout of memory in the storage device (402), receiving (418) the information (410) describing the layout of memory in the storage device (402), determining (420) a write size in dependence upon the layout of memory in the storage device (402), sending (422) a write request (414) addressed to a location within a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402), receiving (406) the write request (414), and writing (408) the data (416) to a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402).
  • In the example method depicted in FIG. 5, the write request (414) includes a physical address (506) of a location in the storage device (402) for storing the data. The physical address (506) of FIG. 5 may be embodied, for example, a value that refers to a particular memory location in the storage device (402) for the entire life of the storage device (402). The physical address (506) of FIG. 5 is distinguished from a virtual address, as a particular physical address (506) will always refer to the same memory location during the life of the storage device (402) and no translation of the particular physical address (506) is required to identify the particular memory location associated with the particular physical address (506). In such an example, the storage array controller (412) may be able to include the physical address (506) in the write request (414), for example, by receiving information describing a physical addressing scheme in the information (410) describing the layout of memory in the storage device (402) and maintaining a page table or other data structure for performing address translation. In such a way, the storage array controller (412) can be configured to send memory access requests (e.g., read, write, erase) to the storage device (402), without requiring the storage device (402) to perform address translation operations in order to service the memory access requests.
  • In the example method depicted in FIG. 5, the information (410) describing the layout of memory in the storage device (402) includes information (502) describing a size of a writeable memory unit in the storage device (402). The writeable memory unit in the storage device (402) may be embodied, for example, as the smallest unit within a storage device (402) that data may be written to when executing a single write operation. The smallest writeable memory unit in the storage device (402) may be embodied as a 16 KB page, such that two write operations cannot be directed to the same 16 KB page without overwriting (via an erase and program cycle) data written to the 16 KB page by the first write operation.
  • In the example method depicted in FIG. 5, the information (410) describing the layout of memory in the storage device (402) includes information (504) describing a size of an erasable memory unit in the storage device (402). The erasable memory unit in the storage device (402) may be embodied, for example, as the smallest unit within a storage device (402) that is erased when executing a single erase operation. For example, the erasable memory unit may be embodied as an 8 MB block. In such an example, when a single erase command is executed, the entire 8 MB block is erased and all data stored in the 8 MB block is lost, unless such data is rewritten elsewhere prior to executing the erase command.
  • In the example method depicted in FIG. 5, writing (408) the data (416) to a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402) can alternatively include writing (508) the data to an unused portion of the memory unit (424, 426, 428, 430). The unused portions of the memory unit (424, 426, 428, 430) may be embodied, for example, as empty pages within a block. For example, an 8 MB block may only include data stored in the pages that comprise the first 3 MB of the block, meaning that no data is stored in the pages that comprise the last 5 MB of the block. In such an example, writing (508) the data to an unused portion of the memory unit (424, 426, 428, 430) may therefore be carried out by writing data to some portion of the pages that comprise the last 5 MB of the block.
  • In the example method depicted in FIG. 5, writing (408) the data (416) to a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402) can alternatively include writing (510) the data to an unused memory unit (424, 426, 428, 430). The unused memory unit (424, 426, 428, 430) may be embodied, for example, as an entire empty block. For example, an 8 MB block may have been recently subjected to an erase operation, meaning that no data is stored in the entire 8 MB block. In such an example, writing (510) the data to an unused memory unit (424, 426, 428, 430) may therefore be carried out by writing data to one or more pages within the block.
  • For further explanation, FIG. 6 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device (402) according to embodiments of the present disclosure. The example method depicted in FIG. 6 is similar to the example method depicted in FIG. 4, as the example method depicted in FIG. 6 also includes sending (404) information (410) describing the layout of memory in the storage device (402), receiving (418) the information (410) describing the layout of memory in the storage device (402), determining (420) a write size in dependence upon the layout of memory in the storage device (402), sending (422) a write request (414) addressed to a location within a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402), receiving (406) the write request (414), and writing (408) the data (416) to a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402).
  • The example method depicted in FIG. 6 also includes sending (602), by the storage array controller (412), a request (604) to expose an underlying physical layout of the memory in the storage device (402). The request (604) to expose the underlying physical layout of the memory in the storage device (402) may be sent (602) from the storage array controller (412) to the storage device (402) via a midplane and one or more data communications links as described above with reference to FIG. 1. The storage array controller (412) may send (602) the request (604) to the storage device (402), for example, when the storage array controller (412) is booted, in response to detecting that the storage device (402) has been powered up or otherwise added to the storage array, and so on.
  • For further explanation, FIG. 7 sets forth a flow chart illustrating an additional example method of exposing a geometry of a storage device (402) according to embodiments of the present disclosure. The example method depicted in FIG. 7 is similar to the example method depicted in FIG. 4, as the example method depicted in FIG. 7 also includes sending (404) information (410) describing the layout of memory in the storage device (402), receiving (418) the information (410) describing the layout of memory in the storage device (402), determining (420) a write size in dependence upon the layout of memory in the storage device (402), sending (422) a write request (414) addressed to a location within a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402), receiving (406) the write request (414), and writing (408) the data (416) to a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402).
  • In the example method depicted in FIG. 7, sending (422) a write request (414) addressed to a location within a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402) can include identifying (702) an unused portion of the memory unit (424, 426, 428, 430). The unused portions of the memory unit (424, 426, 428, 430) may be embodied, for example, as empty pages within a block. For example, an 8 MB block may only include data stored in the pages that comprise the first 3 MB of the block, meaning that no data is stored in the pages that comprise the last 5 MB of the block. In such an example, writing (508) the data to an unused portion of the memory unit (424, 426, 428, 430) may therefore be carried out by writing data to some portion of the pages that comprise the last 5 MB of the block.
  • The storage array controller (412) of FIG. 7 may identify (702) the unused portion of the memory unit (424, 426, 428, 430), for example, by tracking which portions of the memory unit (424, 426, 428, 430) have been written to since the last time that the memory unit (424, 426, 428, 430) was erased. In such an example, the storage array controller (412) may be configured to direct write requests to contiguous portions of a memory unit (424, 426, 428, 430) until all portions of the memory unit (424, 426, 428, 430) have been written to since the last time that the memory unit (424, 426, 428, 430) was erased. For example, the storage array controller (412) may direct a first write request to a first portion (e.g., a first page) of the particular memory unit (424, 426, 428, 430), the storage array controller (412) may direct a second write request to a second portion (e.g., a second page) of the particular memory unit (424, 426, 428, 430), and so on.
  • In the example method depicted in FIG. 7, sending (422) a write request (414) addressed to a location within a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402) can also include including (704) an address for the unused portion of the memory unit (424, 426, 428, 430) in the write request (414). The address for the unused portion of the memory unit (424, 426, 428, 430) in the write request (414) may be embodied, for example, as a logical address that is to be translated by the storage device (402) or, alternatively, as a physical address that requires no translation by the storage device (402).
  • In the example method depicted in FIG. 7, sending (422) a write request (414) addressed to a location within a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402) can alternatively include identifying (706) an unused memory unit (424, 426, 428, 430). The unused memory unit (424, 426, 428, 430) may be embodied, for example, as an entire empty block. For example, an 8 MB block may have been recently subjected to an erase operation, meaning that no data is stored in the entire 8 MB block. In such an example, writing (510) the data to an unused memory unit (424, 426, 428, 430) may therefore be carried out by writing data to one or more pages within the block.
  • The storage array controller (412) of FIG. 7 may identify (706) the unused memory unit (424, 426, 428, 430), for example, by tracking which memory units (424, 426, 428, 430) have been written to since the last time that each memory unit (424, 426, 428, 430) was erased. In such an example, the storage array controller (412) may be configured to direct write requests to contiguous portions of a memory unit (424, 426, 428, 430) until all portions of the memory unit (424, 426, 428, 430) have been written to since the last time that the memory unit (424, 426, 428, 430) was erased. For example, the storage array controller (412) may direct a first write request to a first portion (e.g., a first page) of the particular memory unit (424, 426, 428, 430), the storage array controller (412) may direct a second write request to a second portion (e.g., a second page) of the particular memory unit (424, 426, 428, 430), and so on. In examples where the storage array controller (412) is tasked with writing an amount of data that is larger than the amount of free space in a partially used memory unit (424, 426, 428, 430), the storage array controller (412) may identify an entirely unused memory unit (424, 426, 428, 430) and begin directing write requests to the entirely unused memory unit (424, 426, 428, 430).
  • In the example method depicted in FIG. 7, sending (422) a write request (414) addressed to a location within a memory unit (424, 426, 428, 430) in dependence upon the layout of memory in the storage device (402) can also include including (708) an address for the unused memory unit (424, 426, 428, 430) in the write request (414). The address for the unused memory unit (424, 426, 428, 430) in the write request (414) may be embodied, for example, as a logical address that is to be translated by the storage device (402) or, alternatively, as a physical address that requires no translation by the storage device (402).
  • Readers will appreciate that although the examples depicted in the flowcharts included above illustrate examples where various steps are depicted as occurring in a certain order, such an ordering is not necessarily required according to embodiments of the present disclosure. In fact, a requirement that steps be performed in a certain order only exists where the performance of a particular step is described as occurring ‘responsive to’ the performance of another step. As such, the examples depicted above only illustrate specific embodiments of the present disclosure.
  • Example embodiments of the present disclosure are described largely in the context of a fully functional computer system. Readers of skill in the art will recognize, however, that the present disclosure also may be embodied in a computer program product disposed upon computer readable media for use with any suitable data processing system. Such computer readable storage media may be any transitory or non-transitory media. Examples of such media include storage media for machine-readable information, including magnetic media, optical media, or other suitable media. Examples of such media also include magnetic disks in hard drives or diskettes, compact disks for optical drives, magnetic tape, and others as will occur to those of skill in the art. Persons skilled in the art will immediately recognize that any computer system having suitable programming means will be capable of executing the steps of the method of the invention as embodied in a computer program product. Persons skilled in the art will recognize also that, although some of the example embodiments described in this specification are oriented to software installed and executing on computer hardware, nevertheless, alternative embodiments implemented as firmware, as hardware, or as an aggregation of hardware and software are well within the scope of embodiments of the present disclosure.
  • It will be understood from the foregoing description that modifications and changes may be made in various embodiments of the present disclosure without departing from its true spirit. The descriptions in this specification are for purposes of illustration only and are not to be construed in a limiting sense. The scope of the present disclosure is limited only by the language of the following claims.

Claims (20)

What is claimed is:
1. A method, comprising:
determining, by a processing device of a storage array controller, a write size based on information describing a layout of memory in a storage device operatively coupled to the storage array controller; and
sending a write request to store data at a location of the storage device, wherein the write request is associated with the determined write size and wherein the write request includes a physical address of the location in the storage device to store the data.
2. The method of claim 1, wherein the write request causes the storage device to store the data at the location.
3. The method of claim 1, wherein the physical address refers to the location in the storage device for an entire life of the storage device.
4. The method of claim 1, wherein the write size is determined upon receiving the information describing the layout of the memory from the storage device.
5. The method of claim 1, wherein the information describing the layout of memory in the storage device includes information describing a size of a writeable memory unit in the storage device.
6. The method of claim 5, wherein the write size corresponds to the size of the writeable memory unit in the storage device.
7. The method of claim 1, wherein the information describing the layout of memory in the storage device includes information describing a size of an erasable memory unit in the storage device.
8. A storage system, comprising:
a plurality of storage devices; and
a storage array controller operatively coupled to the plurality of storage device, the storage array controller comprising a processing device, the processing device to:
determine a write size based on information describing a layout of memory in a storage device of the plurality of storage devices; and
send a write request to store data at a location of the storage device, wherein the write request is associated with the determined write size and wherein the write request includes a physical address of the location in the storage device to store the data.
9. The storage system of claim 8, wherein the write request causes the storage device to store the data at the location.
10. The storage system of claim 8, wherein the physical address refers to the location in the storage device for an entire life of the storage device.
11. The storage system of claim 8, wherein the write size is determined upon receiving the information describing the layout of the memory from the storage device.
12. The storage system of claim 8, wherein the information describing the layout of memory in the storage device includes information describing a size of a writeable memory unit in the storage device.
13. The storage system of claim 12, wherein the write size corresponds to the size of the writeable memory unit in the storage device.
14. The storage system of claim 8, wherein the information describing the layout of memory in the storage device includes information describing a size of an erasable memory unit in the storage device.
15. A non-transitory computer-readable storage medium having instructions stored thereon that when executed by a processing device of a storage array controller, cause the processing device to:
determine, by the processing device, a write size based on information describing a layout of memory in a storage device operatively coupled to the storage array controller; and
send a write request to store data at a location of the storage device, wherein the write request is associated with the determined write size and wherein the write request includes a physical address of the location in the storage device to store the data.
16. The non-transitory computer-readable storage medium of claim 15, wherein the write request causes the storage device to store the data at the location.
17. The non-transitory computer-readable storage medium of claim 15, wherein the physical address refers to the location in the storage device for an entire life of the storage device.
18. The non-transitory computer-readable storage medium of claim 15, wherein the write size is determined upon receiving the information describing the layout of the memory from the storage device.
19. The non-transitory computer-readable storage medium of claim 15, wherein the information describing the layout of memory in the storage device includes information describing a size of a writeable memory unit in the storage device.
20. The non-transitory computer-readable storage medium of claim 15, wherein the information describing the layout of memory in the storage device includes information describing a size of an erasable memory unit in the storage device.
US17/306,025 2015-06-23 2021-05-03 Optimizing Data Write Size Using Storage Device Geometry Pending US20210255794A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/306,025 US20210255794A1 (en) 2015-06-23 2021-05-03 Optimizing Data Write Size Using Storage Device Geometry

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US14/747,842 US9547441B1 (en) 2015-06-23 2015-06-23 Exposing a geometry of a storage device
US15/390,123 US10216447B1 (en) 2015-06-23 2016-12-23 Operating system management for direct flash over fabric storage devices
US16/261,895 US10564882B2 (en) 2015-06-23 2019-01-30 Writing data to storage device based on information about memory in the storage device
US16/746,461 US11010080B2 (en) 2015-06-23 2020-01-17 Layout based memory writes
US17/306,025 US20210255794A1 (en) 2015-06-23 2021-05-03 Optimizing Data Write Size Using Storage Device Geometry

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US16/746,461 Continuation US11010080B2 (en) 2015-06-23 2020-01-17 Layout based memory writes

Publications (1)

Publication Number Publication Date
US20210255794A1 true US20210255794A1 (en) 2021-08-19

Family

ID=57602374

Family Applications (5)

Application Number Title Priority Date Filing Date
US14/747,842 Active US9547441B1 (en) 2015-06-23 2015-06-23 Exposing a geometry of a storage device
US15/390,123 Active 2035-07-19 US10216447B1 (en) 2015-06-23 2016-12-23 Operating system management for direct flash over fabric storage devices
US16/261,895 Active US10564882B2 (en) 2015-06-23 2019-01-30 Writing data to storage device based on information about memory in the storage device
US16/746,461 Active US11010080B2 (en) 2015-06-23 2020-01-17 Layout based memory writes
US17/306,025 Pending US20210255794A1 (en) 2015-06-23 2021-05-03 Optimizing Data Write Size Using Storage Device Geometry

Family Applications Before (4)

Application Number Title Priority Date Filing Date
US14/747,842 Active US9547441B1 (en) 2015-06-23 2015-06-23 Exposing a geometry of a storage device
US15/390,123 Active 2035-07-19 US10216447B1 (en) 2015-06-23 2016-12-23 Operating system management for direct flash over fabric storage devices
US16/261,895 Active US10564882B2 (en) 2015-06-23 2019-01-30 Writing data to storage device based on information about memory in the storage device
US16/746,461 Active US11010080B2 (en) 2015-06-23 2020-01-17 Layout based memory writes

Country Status (1)

Country Link
US (5) US9547441B1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9747039B1 (en) * 2016-10-04 2017-08-29 Pure Storage, Inc. Reservations over multiple paths on NVMe over fabrics
US11226816B2 (en) * 2020-02-12 2022-01-18 Samsung Electronics Co., Ltd. Systems and methods for data placement for in-memory-compute

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100262773A1 (en) * 2009-04-08 2010-10-14 Google Inc. Data striping in a flash memory data storage device
US20130205070A1 (en) * 2012-02-08 2013-08-08 Hitachi, Ltd. Storage apparatus provided with a plurality of nonvolatile semiconductor storage media and storage control method
US20150261444A1 (en) * 2014-03-12 2015-09-17 Kabushiki Kaisha Toshiba Memory system and information processing device

Family Cites Families (181)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5208813A (en) 1990-10-23 1993-05-04 Array Technology Corporation On-line reconstruction of a failed redundant array system
US5403639A (en) 1992-09-02 1995-04-04 Storage Technology Corporation File server having snapshot application data groups
DE9310582U1 (en) 1993-07-15 1993-09-23 Hettich Paul Gmbh & Co LOCKING DEVICE FOR DRAWERS OR THE LIKE
US6412045B1 (en) 1995-05-23 2002-06-25 Lsi Logic Corporation Method for transferring data from a host computer to a storage media using selectable caching strategies
US5933598A (en) 1996-07-17 1999-08-03 Digital Equipment Corporation Method for sharing variable-grained memory of workstations by sending particular block including line and size of the block to exchange shared data structures
US5832529A (en) 1996-10-11 1998-11-03 Sun Microsystems, Inc. Methods, apparatus, and product for distributed garbage collection
US5940838A (en) 1997-07-11 1999-08-17 International Business Machines Corporation Parallel file system and method anticipating cache usage patterns
US6038639A (en) 1997-09-09 2000-03-14 Storage Technology Corporation Data file storage management system for snapshot copy operations
US6286056B1 (en) 1998-06-26 2001-09-04 Seagate Technology Llc Data storage device with small computer system interface providing persistent reservations
US6311251B1 (en) * 1998-11-23 2001-10-30 Storage Technology Corporation System for optimizing data storage in a RAID system
US6799283B1 (en) 1998-12-04 2004-09-28 Matsushita Electric Industrial Co., Ltd. Disk array device
JP2000181803A (en) 1998-12-18 2000-06-30 Fujitsu Ltd Electronic data keeping device with key management function and method therefor
US6834298B1 (en) 1999-09-21 2004-12-21 Siemens Information And Communication Networks, Inc. System and method for network auto-discovery and configuration
US6643641B1 (en) 2000-04-27 2003-11-04 Russell Snyder Web search engine with graphic snapshots
US6804755B2 (en) 2000-06-19 2004-10-12 Storage Technology Corporation Apparatus and method for performing an instant copy of data based on a dynamically changeable virtual mapping scheme
US6912537B2 (en) 2000-06-20 2005-06-28 Storage Technology Corporation Dynamically changeable virtual mapping scheme
US6804703B1 (en) 2000-06-22 2004-10-12 International Business Machines Corporation System and method for establishing persistent reserves to nonvolatile storage in a clustered computer environment
JP2002108573A (en) 2000-09-28 2002-04-12 Nec Corp Disk array device and method for controlling its error and recording medium with its control program recorded thereon
US6954881B1 (en) 2000-10-13 2005-10-11 International Business Machines Corporation Method and apparatus for providing multi-path I/O in non-concurrent clustering environment using SCSI-3 persistent reserve
US6718448B1 (en) 2000-11-28 2004-04-06 Emc Corporation Queued locking of a shared resource using multimodal lock types
US6757769B1 (en) 2000-11-28 2004-06-29 Emc Corporation Cooperative lock override procedure
US6850938B1 (en) 2001-02-08 2005-02-01 Cisco Technology, Inc. Method and apparatus providing optimistic locking of shared computer resources
US7039827B2 (en) 2001-02-13 2006-05-02 Network Appliance, Inc. Failover processing in a storage system
US6986015B2 (en) 2001-12-10 2006-01-10 Incipient, Inc. Fast path caching
US6973549B1 (en) 2001-12-10 2005-12-06 Incipient, Inc. Locking technique for control and synchronization
US8103754B1 (en) 2002-05-02 2012-01-24 Hewlett-Packard Development Company, L.P. Reserving a shared volume in a multiple node data storage system
WO2004021191A1 (en) * 2002-08-29 2004-03-11 Matsushita Electric Industrial Co., Ltd. Semiconductor memory device and method for writing data into flash memory
US7260628B2 (en) 2002-09-06 2007-08-21 Hitachi, Ltd. Event notification in storage networks
US7216164B1 (en) 2002-10-09 2007-05-08 Cisco Technology, Inc. Methods and apparatus for determining the performance of a server
US7028218B2 (en) 2002-12-02 2006-04-11 Emc Corporation Redundant multi-processor and logical processor configuration for a file server
CN1795440A (en) 2003-04-07 2006-06-28 艾特拉克斯公司 Network security system based on physical location
US7437530B1 (en) 2003-04-24 2008-10-14 Network Appliance, Inc. System and method for mapping file block numbers to logical block addresses
US7424498B1 (en) 2003-06-30 2008-09-09 Data Domain, Inc. Probabilistic summary data structure based encoding for garbage collection
US7272674B1 (en) 2003-06-30 2007-09-18 Veritas Operating Corporation System and method for storage device active path coordination among hosts
US7865485B2 (en) 2003-09-23 2011-01-04 Emc Corporation Multi-threaded write interface and methods for increasing the single file read and write throughput of a file server
JP4426262B2 (en) 2003-11-26 2010-03-03 株式会社日立製作所 Disk array device and failure avoiding method for disk array device
US8560747B1 (en) 2007-02-16 2013-10-15 Vmware, Inc. Associating heartbeat data with access to shared resources of a computer system
JP4456909B2 (en) 2004-03-29 2010-04-28 株式会社日立製作所 Backup method, storage system and program thereof
JP2005293774A (en) 2004-04-02 2005-10-20 Hitachi Global Storage Technologies Netherlands Bv Control method of disk unit
US7424482B2 (en) 2004-04-26 2008-09-09 Storwize Inc. Method and system for compression of data for block mode access storage
US7139907B2 (en) 2004-04-29 2006-11-21 International Business Machines Corporation Method and apparatus for implementing distributed SCSI devices using enhanced adapter reservations
US7313636B2 (en) 2004-06-15 2007-12-25 Lsi Corporation Methods and structure for supporting persistent reservations in a multiple-path storage environment
US20060074940A1 (en) 2004-10-05 2006-04-06 International Business Machines Corporation Dynamic management of node clusters to enable data sharing
US7363444B2 (en) 2005-01-10 2008-04-22 Hewlett-Packard Development Company, L.P. Method for taking snapshots of data
US7913300B1 (en) 2005-04-08 2011-03-22 Netapp, Inc. Centralized role-based access control for storage servers
US7577802B1 (en) 2005-04-18 2009-08-18 Netapp, Inc. Accessing a reservable device by transiently clearing a persistent reservation on the device in multi-host system
US8200887B2 (en) 2007-03-29 2012-06-12 Violin Memory, Inc. Memory management system and method
US7366825B2 (en) 2005-04-26 2008-04-29 Microsoft Corporation NAND flash memory management
JPWO2006123416A1 (en) 2005-05-19 2008-12-25 富士通株式会社 Disk failure recovery method and disk array device
US8364845B2 (en) 2005-05-19 2013-01-29 Wyse Technology Inc. Method and system for thin client configuration
US7933936B2 (en) 2005-06-10 2011-04-26 Network Appliance, Inc. Method and system for automatic management of storage space
US7979613B2 (en) 2005-07-15 2011-07-12 International Business Machines Corporation Performance of a storage system
US8429326B2 (en) * 2005-09-12 2013-04-23 Mediatek Inc. Method and system for NAND-flash identification without reading device ID table
JP2007087036A (en) 2005-09-21 2007-04-05 Hitachi Ltd Snapshot maintenance device and method
JP4662548B2 (en) 2005-09-27 2011-03-30 株式会社日立製作所 Snapshot management apparatus and method, and storage system
ITVA20050061A1 (en) 2005-11-08 2007-05-09 St Microelectronics Srl METHOD OF MANAGEMENT OF A NON-VOLATILE MEMORY AND RELATIVE MEMORY DEVICE
JP4927408B2 (en) 2006-01-25 2012-05-09 株式会社日立製作所 Storage system and data restoration method thereof
JP2007199953A (en) 2006-01-25 2007-08-09 Fujitsu Ltd Disk array device and disk array control method
US7743197B2 (en) 2006-05-11 2010-06-22 Emulex Design & Manufacturing Corporation System and method for virtualizing PCIe devices
JP2007233903A (en) 2006-03-03 2007-09-13 Hitachi Ltd Storage controller and data recovery method for storage controller
US8832247B2 (en) 2006-03-24 2014-09-09 Blue Coat Systems, Inc. Methods and systems for caching content at multiple levels
US20080034167A1 (en) 2006-08-03 2008-02-07 Cisco Technology, Inc. Processing a SCSI reserve in a network implementing network-based virtualization
US7987438B2 (en) 2006-08-10 2011-07-26 International Business Machines Corporation Structure for initializing expansion adapters installed in a computer system having similar expansion adapters
US7555599B2 (en) 2006-09-06 2009-06-30 International Business Machines Corporation System and method of mirrored RAID array write management
US7475215B2 (en) 2006-09-08 2009-01-06 Lsi Corporation Identification of uncommitted memory blocks during an initialization procedure
WO2008065695A1 (en) 2006-11-27 2008-06-05 Fujitsu Limited Server management program, mail server management program, server management system, and server management method
US8694712B2 (en) 2006-12-05 2014-04-08 Microsoft Corporation Reduction of operational costs of virtual TLBs
US20080155191A1 (en) 2006-12-21 2008-06-26 Anderson Robert J Systems and methods for providing heterogeneous storage systems
US8370562B2 (en) 2007-02-25 2013-02-05 Sandisk Il Ltd. Interruptible cache flushing in flash memory systems
US9632870B2 (en) 2007-03-29 2017-04-25 Violin Memory, Inc. Memory system with multiple striping of raid groups and method for performing the same
JP4529990B2 (en) 2007-03-30 2010-08-25 ブラザー工業株式会社 Image processing program and image processing apparatus
JP4900811B2 (en) 2007-03-30 2012-03-21 株式会社日立製作所 Storage system and storage control method
US8086652B1 (en) 2007-04-27 2011-12-27 Netapp, Inc. Storage system-based hole punching for reclaiming unused space from a data container
US7958303B2 (en) 2007-04-27 2011-06-07 Gary Stephen Shuster Flexible data storage system
US7991942B2 (en) 2007-05-09 2011-08-02 Stmicroelectronics S.R.L. Memory block compaction method, circuit, and system in storage devices based on flash memories
CN101682503A (en) 2007-05-30 2010-03-24 富士通株式会社 Image encrypting device, image decrypting device, method and program
US7765426B2 (en) 2007-06-07 2010-07-27 Micron Technology, Inc. Emerging bad block detection
US8874854B2 (en) 2007-07-30 2014-10-28 International Business Machines Corporation Method for selectively enabling and disabling read caching in a storage subsystem
US7925837B2 (en) 2008-03-04 2011-04-12 International Business Machines Corporation Maintaining write cache and parity update footprint coherency in multiple storage adaptor configuration
US7970994B2 (en) 2008-03-04 2011-06-28 International Business Machines Corporation High performance disk array rebuild
US8352540B2 (en) 2008-03-06 2013-01-08 International Business Machines Corporation Distinguishing data streams to enhance data storage efficiency
US7873619B1 (en) 2008-03-31 2011-01-18 Emc Corporation Managing metadata
US8621241B1 (en) 2008-04-25 2013-12-31 Netapp, Inc. Storage and recovery of cryptographic key identifiers
US8117464B1 (en) 2008-04-30 2012-02-14 Netapp, Inc. Sub-volume level security for deduplicated data
US9678879B2 (en) 2008-05-29 2017-06-13 Red Hat, Inc. Set partitioning for encoding file system allocation metadata
US8296547B2 (en) 2008-08-27 2012-10-23 International Business Machines Corporation Loading entries into a TLB in hardware via indirect TLB entries
US20100057673A1 (en) 2008-09-04 2010-03-04 Boris Savov Reusable mapping rules for data to data transformation
US20100077205A1 (en) 2008-09-19 2010-03-25 Ekstrom Joseph J System and Method for Cipher E-Mail Protection
US8756369B2 (en) 2008-09-26 2014-06-17 Netapp, Inc. Priority command queues for low latency solid state drives
US7910688B2 (en) 2008-10-22 2011-03-22 Evonik Stockhausen Inc. Recycling superabsorbent polymer fines
JP4399021B1 (en) 2008-10-29 2010-01-13 株式会社東芝 Disk array control device and storage device
US7945733B2 (en) 2008-12-12 2011-05-17 Lsi Corporation Hierarchical storage management (HSM) for redundant array of independent disks (RAID)
US8200922B2 (en) 2008-12-17 2012-06-12 Netapp, Inc. Storage system snapshot assisted by SSD technology
CN102257482B (en) 2008-12-19 2015-06-03 惠普开发有限公司 Redundant data storage for uniform read latency
US8312204B2 (en) 2009-01-23 2012-11-13 Seagate Technology Llc System and method for wear leveling in a data storage device
JP4869368B2 (en) 2009-03-12 2012-02-08 株式会社東芝 Storage device and virtualization device
US9134922B2 (en) 2009-03-12 2015-09-15 Vmware, Inc. System and method for allocating datastores for virtual machines
US7941584B2 (en) 2009-03-26 2011-05-10 Arm Limited Data processing apparatus and method for performing hazard detection
US8205065B2 (en) 2009-03-30 2012-06-19 Exar Corporation System and method for data deduplication
US8560787B2 (en) 2009-03-30 2013-10-15 International Business Machines Corporation Incremental backup of source to target storage volume
TWI397009B (en) 2009-04-30 2013-05-21 Inventec Corp Data processing apparatus of basic input/output system
US8180955B2 (en) 2009-05-06 2012-05-15 Via Telecom, Inc. Computing systems and methods for managing flash memory device
JP4874368B2 (en) * 2009-06-22 2012-02-15 株式会社日立製作所 Storage system management method and computer using flash memory
JP5481985B2 (en) 2009-07-17 2014-04-23 スズキ株式会社 Motorcycle fuel pump mounting structure
EP2302638B1 (en) 2009-09-21 2013-04-17 STMicroelectronics (Rousset) SAS Method for writing and reading data in a non-volatile memory, by means of metadata
TWI428917B (en) * 2009-11-25 2014-03-01 Silicon Motion Inc Flash memory device, data storage system, and operation method of a data storage system
US8250324B2 (en) 2009-11-30 2012-08-21 International Business Machines Corporation Method to efficiently locate meta-data structures on a flash-based storage device
US8510569B2 (en) 2009-12-16 2013-08-13 Intel Corporation Providing integrity verification and attestation in a hidden execution environment
US9134918B2 (en) 2009-12-31 2015-09-15 Sandisk Technologies Inc. Physical compression of data with flat or systematic pattern
US8452932B2 (en) 2010-01-06 2013-05-28 Storsimple, Inc. System and method for efficiently creating off-site data volume back-ups
US9059851B2 (en) 2010-02-23 2015-06-16 Salesforce.Com, Inc. Method and computer program product for order preserving symbol based encryption
JP4892072B2 (en) 2010-03-24 2012-03-07 株式会社東芝 Storage device that eliminates duplicate data in cooperation with host device, storage system including the storage device, and deduplication method in the system
US8301811B1 (en) 2010-03-30 2012-10-30 Emc Corporation Techniques for performing online data migration while effectively migrating SCSI reservations between source and target arrays
US8738970B2 (en) 2010-07-23 2014-05-27 Salesforce.Com, Inc. Generating performance alerts
US8713268B2 (en) 2010-08-05 2014-04-29 Ut-Battelle, Llc Coordinated garbage collection for raid array of solid state disks
US8468318B2 (en) 2010-09-15 2013-06-18 Pure Storage Inc. Scheduling of I/O writes in a storage environment
US8589625B2 (en) 2010-09-15 2013-11-19 Pure Storage, Inc. Scheduling of reconstructive I/O read operations in a storage environment
US8775868B2 (en) 2010-09-28 2014-07-08 Pure Storage, Inc. Adaptive RAID for an SSD environment
US20120117029A1 (en) 2010-11-08 2012-05-10 Stephen Gold Backup policies for using different storage tiers
US8812860B1 (en) 2010-12-03 2014-08-19 Symantec Corporation Systems and methods for protecting data stored on removable storage devices by requiring external user authentication
US8966184B2 (en) 2011-01-31 2015-02-24 Intelligent Intellectual Property Holdings 2, LLC. Apparatus, system, and method for managing eviction of data
US9563555B2 (en) 2011-03-18 2017-02-07 Sandisk Technologies Llc Systems and methods for storage allocation
US8924629B1 (en) * 2011-06-07 2014-12-30 Western Digital Technologies, Inc. Mapping table for improving write operation efficiency
US8595267B2 (en) 2011-06-27 2013-11-26 Amazon Technologies, Inc. System and method for implementing a scalable data storage service
US8751463B1 (en) 2011-06-30 2014-06-10 Emc Corporation Capacity forecasting for a deduplicating storage system
US8806160B2 (en) 2011-08-16 2014-08-12 Pure Storage, Inc. Mapping in a storage system
US8527544B1 (en) 2011-08-11 2013-09-03 Pure Storage Inc. Garbage collection in a storage system
US8788788B2 (en) 2011-08-11 2014-07-22 Pure Storage, Inc. Logical sector mapping in a flash storage array
US8793467B2 (en) 2011-09-30 2014-07-29 Pure Storage, Inc. Variable length encoding in a storage system
JP5768587B2 (en) 2011-08-17 2015-08-26 富士通株式会社 Storage system, storage control device, and storage control method
US8583868B2 (en) * 2011-08-29 2013-11-12 International Business Machines Storage system cache using flash memory with direct block access
JP2013077278A (en) * 2011-09-16 2013-04-25 Toshiba Corp Memory device
US8700875B1 (en) 2011-09-20 2014-04-15 Netapp, Inc. Cluster view for storage devices
WO2013046273A1 (en) 2011-09-29 2013-04-04 Hitachi, Ltd. Reservation of volumes having a copy pair relationship
WO2013051129A1 (en) 2011-10-06 2013-04-11 株式会社 日立製作所 Deduplication method for storage data, deduplication device for storage data, and deduplication program
US8825605B2 (en) 2011-10-11 2014-09-02 Netapp, Inc. Deduplication aware scheduling of requests to access data blocks
US8918579B2 (en) 2012-02-06 2014-12-23 Sandisk Technologies Inc. Storage device and method for selective data compression
US9075710B2 (en) 2012-04-17 2015-07-07 SanDisk Technologies, Inc. Non-volatile key-value store
US9519647B2 (en) 2012-04-17 2016-12-13 Sandisk Technologies Llc Data expiry in a non-volatile device
US8996881B2 (en) 2012-04-23 2015-03-31 International Business Machines Corporation Preserving redundancy in data deduplication systems by encryption
US8793466B2 (en) 2012-04-27 2014-07-29 Netapp, Inc. Efficient data object storage and retrieval
US10474584B2 (en) 2012-04-30 2019-11-12 Hewlett Packard Enterprise Development Lp Storing cache metadata separately from integrated circuit containing cache controller
US9645177B2 (en) 2012-05-04 2017-05-09 Seagate Technology Llc Retention-drift-history-based non-volatile memory read threshold optimization
US8874850B1 (en) 2012-05-10 2014-10-28 Netapp, Inc. Hierarchically tagged cache
US20130318314A1 (en) 2012-05-25 2013-11-28 Red Hat, Inc. Managing copies of data on multiple nodes using a data controller node to avoid transaction deadlock
US9501546B2 (en) 2012-06-18 2016-11-22 Actifio, Inc. System and method for quick-linking user interface jobs across services based on system implementation information
US8959305B1 (en) 2012-06-29 2015-02-17 Emc Corporation Space reclamation with virtually provisioned devices
US9063937B2 (en) 2012-07-31 2015-06-23 Hewlett-Packard Development Company, L.P. Storage array reservation forwarding
US9489293B2 (en) 2012-08-17 2016-11-08 Netapp, Inc. Techniques for opportunistic data storage
US9021263B2 (en) 2012-08-31 2015-04-28 Cleversafe, Inc. Secure data access in a dispersed storage network
JP5954081B2 (en) 2012-09-26 2016-07-20 富士通株式会社 Storage control device, storage control method, and storage control program
US9348757B2 (en) 2012-10-08 2016-05-24 International Business Machines Corporation System supporting multiple partitions with differing translation formats
US9176858B2 (en) 2012-11-19 2015-11-03 Hitachi, Ltd. Storage system configured to selectively utilize data compression based on real pool usage rates
US9348840B2 (en) 2012-12-14 2016-05-24 Intel Corporation Adaptive data striping and replication across multiple storage clouds for high availability and performance
US9646039B2 (en) 2013-01-10 2017-05-09 Pure Storage, Inc. Snapshots in a storage system
US9886346B2 (en) 2013-01-11 2018-02-06 Commvault Systems, Inc. Single snapshot for multiple agents
US9652376B2 (en) 2013-01-28 2017-05-16 Radian Memory Systems, Inc. Cooperative flash memory control
US9335932B2 (en) 2013-03-15 2016-05-10 Bracket Computing, Inc. Storage unit selection for virtualized storage units
US9519575B2 (en) 2013-04-25 2016-12-13 Sandisk Technologies Llc Conditional iteration for a non-volatile device
US9727278B2 (en) * 2013-06-13 2017-08-08 Netapp, Inc. System and methods for mitigating write emulation on a disk device using cache memory
US9430412B2 (en) 2013-06-26 2016-08-30 Cnex Labs, Inc. NVM express controller for remote access of memory and I/O over Ethernet-type networks
US9785545B2 (en) 2013-07-15 2017-10-10 Cnex Labs, Inc. Method and apparatus for providing dual memory access to non-volatile memory
US10263770B2 (en) 2013-11-06 2019-04-16 Pure Storage, Inc. Data protection in a storage system using external secrets
US9516016B2 (en) 2013-11-11 2016-12-06 Pure Storage, Inc. Storage array password management
JP6233086B2 (en) 2014-02-20 2017-11-22 富士通株式会社 Storage control device, storage system, and control program
US9798596B2 (en) 2014-02-27 2017-10-24 Commvault Systems, Inc. Automatic alert escalation for an information management system
US10656864B2 (en) 2014-03-20 2020-05-19 Pure Storage, Inc. Data replication within a flash storage array
US9361469B2 (en) 2014-03-26 2016-06-07 Amazon Technologies, Inc. Electronic communication with secure screen sharing of sensitive information
US9513820B1 (en) 2014-04-07 2016-12-06 Pure Storage, Inc. Dynamically controlling temporary compromise on data redundancy
US9501245B2 (en) 2014-05-02 2016-11-22 Cavium, Inc. Systems and methods for NVMe controller virtualization to support multiple virtual machines running on a host
US9294567B2 (en) 2014-05-02 2016-03-22 Cavium, Inc. Systems and methods for enabling access to extensible storage devices over a network as local storage via NVME controller
CA2894936C (en) * 2014-06-27 2018-02-27 Chenyi Zhang Controller, flash memory apparatus, and method for writing data into flash memory apparatus
US9563509B2 (en) 2014-07-15 2017-02-07 Nimble Storage, Inc. Methods and systems for storing data in a redundant manner on a plurality of storage units of a storage system
US10430282B2 (en) 2014-10-07 2019-10-01 Pure Storage, Inc. Optimizing replication by distinguishing user and system write activity
US9489132B2 (en) 2014-10-07 2016-11-08 Pure Storage, Inc. Utilizing unmapped and unknown states in a replicated storage system
US9565269B2 (en) 2014-11-04 2017-02-07 Pavilion Data Systems, Inc. Non-volatile memory express over ethernet
US9552248B2 (en) 2014-12-11 2017-01-24 Pure Storage, Inc. Cloud alert to replica
CN105843746A (en) * 2015-01-12 2016-08-10 广明光电股份有限公司 Write-in method for solid state disk
US10235097B2 (en) 2015-07-21 2019-03-19 Samsung Electronics Co., Ltd. Area and performance optimized namespace sharing method in virtualized PCIE based SSD controller
US10073769B2 (en) * 2015-10-15 2018-09-11 Silicon Motion, Inc. Data storage device and data maintenance method thereof
TWI537729B (en) * 2015-10-15 2016-06-11 慧榮科技股份有限公司 Data storage device and data maintenance method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100262773A1 (en) * 2009-04-08 2010-10-14 Google Inc. Data striping in a flash memory data storage device
US20130205070A1 (en) * 2012-02-08 2013-08-08 Hitachi, Ltd. Storage apparatus provided with a plurality of nonvolatile semiconductor storage media and storage control method
US20150261444A1 (en) * 2014-03-12 2015-09-17 Kabushiki Kaisha Toshiba Memory system and information processing device

Also Published As

Publication number Publication date
US20160378351A1 (en) 2016-12-29
US20200150891A1 (en) 2020-05-14
US9547441B1 (en) 2017-01-17
US11010080B2 (en) 2021-05-18
US10564882B2 (en) 2020-02-18
US10216447B1 (en) 2019-02-26
US20190163390A1 (en) 2019-05-30

Similar Documents

Publication Publication Date Title
US10970202B1 (en) Managing input/output (‘I/O’) requests in a storage system that includes multiple types of storage devices
US10540307B1 (en) Providing an active/active front end by coupled controllers in a storage system
US11385801B1 (en) Offloading device management responsibilities of a storage device to a storage controller
US10929231B1 (en) System configuration selection in a storage system
US11868625B2 (en) Alert tracking in storage
US20210255794A1 (en) Optimizing Data Write Size Using Storage Device Geometry
US10310740B2 (en) Aligning memory access operations to a geometry of a storage device
AU2015408284A1 (en) Adjusting storage capacity in a computing system
US11630585B1 (en) Processing evacuation events in a storage array that includes a plurality of storage devices
EP3314389B1 (en) Aligning memory access operations to a geometry of a storage device

Legal Events

Date Code Title Description
AS Assignment

Owner name: PURE STORAGE, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:COLGROVE, JOHN;KIRKPATRICK, PETER E.;REEL/FRAME:056114/0311

Effective date: 20150623

STPP Information on status: patent application and granting procedure in general

Free format text: APPLICATION DISPATCHED FROM PREEXAM, NOT YET DOCKETED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STCV Information on status: appeal procedure

Free format text: NOTICE OF APPEAL FILED

STCV Information on status: appeal procedure

Free format text: APPEAL BRIEF (OR SUPPLEMENTAL BRIEF) ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: TC RETURN OF APPEAL

STCV Information on status: appeal procedure

Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS