US20150039787A1 - Multi-protocol storage controller - Google Patents
Multi-protocol storage controller Download PDFInfo
- Publication number
- US20150039787A1 US20150039787A1 US13/964,670 US201313964670A US2015039787A1 US 20150039787 A1 US20150039787 A1 US 20150039787A1 US 201313964670 A US201313964670 A US 201313964670A US 2015039787 A1 US2015039787 A1 US 2015039787A1
- Authority
- US
- United States
- Prior art keywords
- protocol
- storage device
- storage
- storage controller
- detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0653—Monitoring storage devices or systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/382—Information transfer, e.g. on bus using universal interface adapter
- G06F13/385—Information transfer, e.g. on bus using universal interface adapter for adaptation of a particular data processing system to different peripheral devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/40—Bus structure
- G06F13/4063—Device-to-bus coupling
- G06F13/4068—Electrical coupling
- G06F13/4081—Live connection to bus, e.g. hot-plugging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F2213/0026—PCI express
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F2213/0028—Serial attached SCSI [SAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F2213/38—Universal adapter
- G06F2213/3802—Harddisk connected to a computer port
Definitions
- the invention generally relates to field of storage controllers.
- PCIe Peripheral Component Interconnect Express protocol
- SAS Serial Attached Small Computer System Interface
- PCIe storage devices are “hot-swapped” in place of SAS storage devices.
- PCIe is a packet based, connectionless transfer protocol
- SAS is an end-to-end, connection based protocol that does not provide for connectionless transfers, making interoperability particularly challenging.
- storage controllers employing one protocol are incapable of detecting storage devices of another protocol when hot swapped into the domain.
- a storage controller includes an interface operable to communicatively couple to a storage device.
- the storage controller also includes a processor operable to select between hardware protocol detection of the storage device and firmware protocol detection of the storage device, and to detect a protocol of the storage device when the storage device communicatively couples to the interface according to the selected protocol detection.
- the storage controller selects a protocol to process input/output requests from a host based on the detected protocol of the storage device.
- the various embodiments disclosed herein may be implemented in a variety of ways as a matter of design choice.
- the embodiments may take the form of computer hardware, software, firmware, or combinations thereof.
- Other exemplary embodiments are described below.
- FIG. 1 is a block diagram of an exemplary storage controller operable with devices of differing protocols.
- FIG. 2 is a flowchart of an exemplary process of the storage controller of FIG. 1 .
- FIG. 3 is a block diagram of another exemplary storage controller.
- FIG. 4 is a flowchart of an exemplary process of the storage controller of FIG. 3 .
- FIG. 5 is a graph of an exemplary hardware protocol detection scheme of the storage controllers of FIGS. 1 and 3 .
- FIG. 6 is a flowchart of another exemplary process of the storage controller of FIG. 3 .
- FIG. 7 is a block diagram of an exemplary computing system in which a computer readable medium provides instructions for performing methods herein.
- FIG. 1 is a block diagram of an exemplary storage controller 104 operable with devices of differing protocols.
- the storage controller 104 is operable to process I/O requests of a host system 105 and direct those I/O requests to various target devices 110 , 111 , and 112 according to their respective storage protocols.
- the target devices 110 are SAS storage devices
- the target devices 111 are PCIe storage devices
- the target device 112 is a storage device using some other protocol (e.g., a Serial Attached AT Attachment (SATA) protocol, a Fibre Channel over Internet Protocol protocol, an Enterprise Systems Connection, a Fibre Channel protocol, a Universal Serial Bus (USB) protocol, an Internet Serial Attached Small Computer System Interface (ISCSI) protocol, etc.).
- SATA Serial Attached AT Attachment
- USB Universal Serial Bus
- ISCSI Internet Serial Attached Small Computer System Interface
- the storage controller 104 is operable to discover, via hardware and/or firmware, the type of storage device it connects to when one of the target devices 110 , 111 , 112 is coupled to the storage controller 104 . Once discovered, the storage controller 104 can process I/O requests from the host system 105 to any of the target devices 110 , 111 , 112 via their respective storage protocols.
- the target devices 110 , 111 , 112 may be directly attached the storage controller 104 or they may be coupled through a storage system expansion component, such as the expander 103 .
- a storage system expansion component such as the expander 103 .
- one or more expanders may be operable to directly attach to other target devices 110 , 111 , 112 as well as other expanders to provide a “switched fabric” that switches I/O request to appropriate devices as determined by the storage controller 104 .
- An example of the expander 103 includes a wide port expander operable with multiple protocols, such as those mentioned (e.g., SAS, PCIe, USB, SATA, etc.).
- Examples of the target devices 110 , 111 , 112 include storage devices, such as disk drives and solid state drives (SSDs).
- the target devices 110 , 111 , 112 may provide data storage on behalf of the host system 105 .
- the host system 105 may configure read/write requests for input/output (I/O) operations with any of the target devices 110 , 111 , 112 .
- the host system 105 may be any suitable computing device or system operable to perform I/O operations, for example, servers, workstations, personal computers, etc.
- the storage controller 104 is any device, system, software, or combination thereof operable to perform device discovery, manage I/O requests to the target devices 110 , 111 , 112 , and process I/O commands directed to data thereof.
- the storage controller 104 may be implemented as custom circuitry, as a special or general purpose processor executing programmed instructions stored in an associated program memory, or some combination thereof.
- the storage controller 104 may be an independent SAS device, a Host Bus Adapter (HBA) of a host, or an integrated component of the host system 105 .
- HBA Host Bus Adapter
- the storage controller 104 includes a frontend interface adapted to couple to and receive I/O requests of the host system 105 .
- the storage controller 104 also includes a backend interface (shown and described in greater detail below) that is adapted to couple to and support PCIe devices (e.g., PCIe compatible expanders, PCIe switches, and PCIe target devices 111 ), SAS devices (e.g., SAS target devices 110 and SAS expanders), and others.
- PCIe devices e.g., PCIe compatible expanders, PCIe switches, and PCIe target devices 111
- SAS devices e.g., SAS target devices 110 and SAS expanders
- the expander 103 is any device, system, software, or combination thereof operable to expand a storage system via possible connections to multiple storage devices.
- the expander 103 may connect to SAS components, such as SAS target devices 110 and other expanders via a plurality of physical transceivers, or “Phys”. More particularly, the expander 103 may be operable to directly attach to a plurality of target devices via a number of different protocols, such as those mentioned (e.g., SAS, PCIe, USB, SATA, etc.) and may utilize the protocol detection methods present in the storage controller 104 .
- FIG. 2 is a flowchart of an exemplary process 200 operable with the storage controller 104 of FIG. 1 .
- the process 200 initiates when the storage controller 104 communicatively couples to a storage device, in the process element 201 .
- the storage controller 104 begins a hardware discovery and/or a firmware discovery of the target device.
- the storage controller 104 selects between a hardware protocol detection of the storage device and a firmware protocol detection of the storage device, in the process element 202 .
- the storage controller automatically begins detecting the protocol of the storage device, in the process element 203 .
- a hardware detection scheme may be employed by the storage controller 104 to determine the protocol of the storage device when it couples to an interface of the storage controller via hardware signaling and/or time domain reflectometry. If the storage device is not detected via the hardware protocol detection scheme, the storage controller 104 may fail over to a firmware detection scheme by attempting link establishment via various protocols until the storage device responds.
- the storage controller 104 may, however, also be configured to initiate from a firmware protocol detection scheme and failover to a hardware protocol detection scheme or even be configured to only use one or the other detection schemes to detect the protocol of the attached storage device.
- the storage controller 104 selects a protocol to process I/O requests from the host system 105 , in the process element 204 .
- the storage controller 104 may be configured with a variety of protocol stacks. Once the protocol of the storage device is detected, the storage controller 104 processes the I/O requests from the host system 105 through the appropriate protocol stack.
- FIG. 3 is a block diagram of another exemplary storage controller 104 .
- the storage controller 104 is configured with a system interface 301 that is operable to communicatively and physically couple the storage controller 104 to the physical interface of the host system 105 and process I/O requests according to PCIe and SAS/SATA protocol stacks.
- the PCIe stack comprises PCIe upper layers 302 , a PCIe link layer 304 , and a PCIe physical layer 306 , or Phy.
- the SAS/SATA stack comprises SAS/SATA upper layers 303 , a SAS/SATA link layer 305 , and a SAS/SATA physical layer 307 , or Phy.
- the storage controller 104 also comprises protocol selection logic 308 that is operable to select the appropriate protocol stack when the protocol of the storage device is detected.
- protocol selection logic 308 is operable to select the appropriate protocol stack when the protocol of the storage device is detected.
- a protocol multiplexer 309 is communicatively coupled to the protocol selection logic 308 to control which of the protocol stacks will be used when the protocol the storage device is detected.
- the protocol selection logic 308 and associated protocol multiplexer 309 work in conjunction to choose whether the storage device's physical interface connects to the PCIe protocol stack or the SAS/SATA protocol stack.
- the serial/deserializer (SerDes) 310 is operable to perform a hardware protocol detection of the attached storage device. Indication of successful link establishment is passed from both the PCIe link layer 304 and the SAS/SATA link layer 307 to ensure that the protocol multiplexer 309 remains fixed on a currently selected protocol when success is achieved.
- a particular protocol's link and Phy layers are enabled when the protocol multiplexer 309 is currently selecting that protocol so as to minimize power consumption. For example, power can be reduced by quiescing an unused protocol stack of the storage controller 104 and turning off a clock in the storage controller 104 . This prevents MOS gates from toggling, which can contribute to a significant waster of power in semiconductors due to switching of the capacitive loads of the gates.
- a loss of signal indication from the SerDes 310 is used directly by the SAS/SATA Phy layer 307 even when the protocol multiplexer 309 is currently selecting PCIe protocol to allow a rapid switch over to SAS/SATA protocol in the event that valid SAS/SATA Out Of Band (OOB) signals are detected.
- the protocol multiplexer 309 may be directed by the protocol selection logic 308 to select the PCIe protocol stack for communication with the attached storage device.
- the attached storage device may be a SAS/SATA storage device.
- the storage controller 104 may be operable to more quickly hardware detect the OOB signals of the SAS/SATA device while the PCIe protocol stack is attempting to communicate with the attached storage device.
- the detection of OOB signals may actually take place in the SAS/SATA Phy layer 307 .
- the SerDes 310 provides loss of signal indication to the SAS/SATA Phy layer 307 which, in turn, looks for a proper OOB pattern.
- the protocol selection logic 308 selects the SAS/SATA protocol stack and ceases attempts by the PCIe protocol stack to communicate with the attached storage device.
- the automatic OOB detection process can be provided in parallel to the detection of progress on the PCIe link layer 304 .
- the protocol multiplexer 309 switches over to SAS/SATA control (i.e., the SAS/SATA protocol stack) such that an OOB signal may be sent in reply to the attached storage device.
- SAS/SATA control i.e., the SAS/SATA protocol stack
- the protocol multiplexer 309 may periodically switch to the SAS/SATA protocol stack to send an OOB signal to comply with the Hotplug timeout requirements of the T10 SAS standards (T10 is the technical committee that establishes the standards for SCSI, SATA, and SAS).
- T10 is the technical committee that establishes the standards for SCSI, SATA, and SAS.
- an indication of a successful link being established may be passed from the PCIe link layer 304 to the SAS/SATA link layer 305 via the protocol selection logic 308 , and vice versa, such that the protocol selection logic 308 halts any further attempts to switch protocols (e.g., by alerting the firmware of the storage controller 104 to the successful result via an interrupt or some other means).
- FIG. 4 is a flowchart of one such exemplary process of protocol detection selection by the storage controller 104 . More specifically, a programmable protocol selection method is illustrated in FIG. 4 that provides the firmware of the storage controller 104 with the ability to choose the protocol based on a priori knowledge of the system configuration.
- the storage controller 104 may enable firmware protocol detection, in the process element 351 , such that firmware attempts to initiate communication with the attached storage device before or in parallel with hardware detection.
- the storage device being attached to the storage controller 104 may be known such that the firmware of the storage controller 104 can automatically initiate protocol detection via a predetermined firmware selection of the protocol, in the process element 352 .
- the firmware of the storage controller 104 may automatically choose the PCIe protocol, in the process element 354 , if the device is known to be a PCIe storage device or the SAS/SATA protocol if the device is known to be a SAS/SATA storage device, in the process element 355 .
- the firmware protocol detection of the process element 352 may provide the storage controller 104 with the ability to cycle through the available protocols of the storage controller 104 until a connection is made with the attached storage device.
- the firmware may alternate between protocols looking for a “PhyReady” SAS/SATA condition or a “LinkUp” PCIe condition. In either case, the firmware of the storage controller 104 chooses either PCIe or SAS/SATA operation, and the protocol multiplexer 309 is set to the appropriate protocol until the firmware of the storage controller 104 changes the configuration.
- the storage controller 104 would generally implement a hardware protocol detection in the process element 356 .
- the hardware sensed protocol detection of the process element 356 mode may be enabled if the storage controller 104 firmware has no knowledge of the protocol to expect and decides to not cycle between the protocols. Once the hardware sensed protocol detection successfully achieves a PhyReady or LinkUp state with a particular protocol, any further protocol switching is suspended until it is enabled again by firmware. If the hardware sensed protocol detection of the process element 356 is disabled, the protocol multiplexer 309 may be held in an idle position such that no protocol stack is selected. For example, both the PCIe and SAS protocol stacks of the storage controller 104 in this respect would remain quiescent.
- the storage controller 104 may be configured to cycle through protocol stacks (process element 358 ), automatically detect the protocol of the OOB signals (process element 359 ), and/or transmit a pulse and analyze the reflected wave via time domain reflectometry, or “TDR”, (process element 360 ).
- the protocol multiplexer 309 may alternate between PCIe and SAS/SATA protocol stacks with a programmable dwell time for each protocol until success for any protocol is achieved, in the process element 358 . After a successful connection via a particular protocol is established, an interrupt directs the storage controller 104 to begin processing I/O requests according to the protocol of the storage device.
- the protocol multiplexer 309 may be configured to default to the PCIe Phy layer 306 , but a loss of signal indication, such as an RXLOS signal, would still be transferred to the SAS/SATA Phy layer 307 to support OOB sequence detection. Then, if the storage controller 104 is able to successfully establish a link via the PCIe protocol (e.g., “LinkUp”), the protocol multiplexer 309 locks into the PCIe protocol stack of the storage controller 104 .
- a loss of signal indication such as an RXLOS signal
- the protocol multiplexer 309 switches to the SAS/SATA Phy layer 307 such that the SAS/SATA Phy layer 307 may send a COMINIT to the attached storage device. If no protocol is successful within a programmable Hotplug timeout period (typically 10-500 ms), then the storage controller 104 may automatically select the SAS/SATA Phy layer 307 by sending a COMINIT to the storage device in an attempt to “brute force” connect to the storage device. Alternatively, the storage controller 104 may simply continue monitoring or perform an alternative protocol detection scheme.
- a programmable Hotplug timeout period typically 10-500 ms
- the SerDes 310 periodically sends a pulse and analyzes the reflected wave to detect a distinct AC coupling characteristic which indicates the protocol of the attached device.
- the storage device based on its standardized storage protocol electrical requirements, has a particular analog signaling characteristic.
- a TDR pulse transmitted to the storage device would be reflected back to the SerDes 310 and analyzed by the storage controller 104 to determine the type of storage device that is coupled to the storage controller 104 .
- An example of such hardware/TDR detection is shown and described below in FIG. 5 .
- FIG. 5 is a graph 370 of an exemplary hardware detection scheme of the storage controllers 104 .
- One particular challenge in sensing PCIe versus SAS electrical characteristics is the broad range of passive channel lengths employed in SAS.
- SAS channel lengths may range from just a few centimeters to as many as 10 meters, which can induce a delay in a reflected TDR wave of many 10 s of nanoseconds (e.g., illustrated as “time of flight ⁇ 2”).
- a sample timer may be implemented by the SerDes 310 to determine when to sample the reflected wave and make an assessment of the charge characteristic.
- a timer may be configured to start when the TDR pulse is launched (i.e., the bolder line 371 ).
- a threshold 372
- Another alternative would include a dV/dt receiver being used to detect the arrival of the reflected TDR pulse. Once the reflected TDR pulse arrives, the sample timer would be started ( 373 ).
- the voltage at the SerDes 310 can be sampled (e.g., sample points 380 ) and compared to various threshold voltages (e.g., 372 , 374 , 375 ). For example, if a SAS charge detection threshold is exceeded, the TDR pulse would indicate that a SAS Device is attached to the storage controller 104 . Otherwise, the TDR pulse would indicate that a PCIe storage device is attached or that no devices attached at all ( 375 ).
- thresholds could be programmed into the firmware of the storage controller 104 to provide flexibility in different implementations and operating environments.
- a failsafe timer may be used to determine the type of storage device that is attached to the storage controller 104 . For example, at a launch of TDR pulse ( 371 ), a failsafe timer set to twice the maximum cable length delay may be started. If a reflected TDR pulse is detected, the sample timer would be triggered and sampling (e.g., sample points 380 ) of the charge value would occur. If no reflected TDR pulse is observed, sampling of the charge value would occur when the fail safe timer expires. For example, if a link is properly terminated, then there is no reflection and the fail safe timer would start. If the link is not terminated, then the reflection triggers the detection automatically at a time based on twice the delay of the maximum length of the transmission line.
- a baseline timer ( 376 ) could be used in conjunction with the failsafe timer to make an assessment of a charge slope (e.g., 390 , 391 , 392 ) based on sampling rather than basing the assessment purely on absolute voltage thresholds.
- the baseline timer may be used to sample the reflected TDR pulse shortly after the TDR pulse has been received.
- the baseline timer may capture the first point in determining the charge slope. Thereafter, the sample timer can be used to capture the second point from which the charge slope may be determined. Multiple samples may of course be used to improve accuracy and improve noise immunity (i.e., more accurately determine what is signal and what is noise).
- This reflected TDR pulse detection technique for starting the sample timer provides flexibility for channels of a variety of lengths, including those beyond the 10 meter passive length limit of SAS. Additional thresholds could also be employed to provide finer discrimination of charge characteristics associated with the various protocols. An analog-to-digital converter could be employed to perform the detection with the charge level being determined via numeric comparison. Additional accuracy could be achieved by taking multiple samples during the charge time and performing numerical analysis and curve fitting on the resultant sample points 380 prior to making a determination on the charge characteristic.
- FIG. 6 is a flowchart of another exemplary process 400 of the storage controller 104 .
- the process 400 illustrates hysteresis in a selected protocol.
- the storage controller 104 can attempt to reestablish the link with a most recently used protocol. Such may be useful for cases where a link is reset due to firmware-directed reinitialization when a new device is not actually installed. For example, the firmware resets the storage controller 104 , in the process element 401 , and connection to a storage device is then lost.
- the storage controller 104 may then perform a receiver detect sequence to acquire a previously attached PCIe device after initialization of the storage controller 104 , in the process element 402 .
- the storage controller 104 may perform this operation a number of times after some delay (process element 403 ) until the PCIe device is detected, in the process element 404 .
- the storage controller 104 may be configured to attempt detection of the attached storage device some predetermined number of times before switching to another form of protocol detection.
- the storage controller selects the PCIe protocol stack to set the PCIe mode of the storage controller 104 , in the process element 405 .
- the storage controller 104 then enables the PCIe link initialization of the PCIe link layer 304 , in the process element 406 .
- the storage controller 104 makes a determination as to whether the PCIe initialization is making progress, in the process element 407 .
- the storage controller 104 initiates a PCIe progress timer, in the process element 408 , looping through until a link is established with the PCIe device, in the process element 409 . Once the link is established, the storage controller initiates a Hotplug timer to determine if the PCIe device is ready to communicate with the storage controller 104 , in the process elements 410 and 412 . The purpose of the loop is to allow a certain amount of time to reestablish communications with the PCIe device before trying the SAS/SATA protocol if the PCIe Link becomes not ready at any point.
- the storage controller 104 may attempt to establish a connection by re-initiating the receiver detect sequence of the process element 402 . But, as long as a link is up, the Hotplug timer continues to be reset. If the link drops, the Hotplug timer continues running so that there is only so much time given to try and reestablish the link with that particular protocol. If the Hotplug timer eventually expires (e.g., process elements 413 and 422 ), then the storage controller 104 attempts communication via another protocol.
- the storage controller 104 determines whether the Hotplug timer initiated in the process element 410 has expired, in process element 413 . If not, the SerDes 310 determines whether the SAS OOB signal has been detected, in the process element 414 . If not, the storage controller 104 returns to the process element 407 to determine whether the PCIe initialization is making progress. If the Hotplug timer has expired or the SAS OOB signal has been detected, the storage controller 104 selects the SAS/SATA protocol stack to establish the SAS/SATA mode of the storage controller 104 , in the process element 415 . In this regard, the storage controller 104 enables SAS/SATA link initialization of the SAS/SATA link layer 305 , in the process element 416 , thereby making the decision to abandon PCIe initialization.
- the storage controller 104 determines whether the SAS initialization has begun and is making progress, in the process element 417 . If so, the storage controller 104 initiates a SAS initialization progress timer, in the process element 418 , and determines whether the SAS/SATA link is established, in the process element 419 . For example, the SAS initialization progress timer may establish a certain amount of time for the storage controller 104 to link to the storage device, assuming that it is a SAS storage device. If the link is not established within that amount of time, the storage controller 104 may return to the process element 417 to determine whether the SAS initialization is making progress or not.
- the storage controller 104 initiates the Hotplug timer in the process element 420 and determines whether the link is ready in the process element 421 . If the link is not ready, the storage controller 104 may return to the process element 417 to determine whether the SAS initialization is making progress. If so, the storage controller 104 may continually initialize the Hotplug timer while the link is up. Otherwise, the storage controller 104 may determine that the link is not ready and attempt to reenable the SAS/SATA link initialization in the process element 416 .
- the storage controller 104 determines whether the Hotplug timer has expired, in the process element 422 . If not, the storage controller 104 may continue waiting for SAS initialization until the Hotplug timer expires. When the timer does indeed expire, the storage controller 104 returns to process element 402 to perform another receiver detection sequence (e.g., select another protocol stack, protocol detection scheme, quit detection altogether, etc.).
- another receiver detection sequence e.g., select another protocol stack, protocol detection scheme, quit detection altogether, etc.
- the above embodiments provide several advantages over current protocol detection schemes.
- the above embodiments provide for dynamically or statically configuring protocol detections capable of detecting any of a variety of protocols. While two protocol stacks are illustrated, the invention is not to be limited to such.
- the storage controller 104 may be configured with a variety of protocol stacks that allow the storage controller to couple to and communicate with a variety target devices.
- the protocol detection schemes include cycling through protocols performing parallel protocol detection of OOB signaling of the SAS protocol, and passive protocol detection via hardware sensing electrical characteristics of the attached devices.
- FIG. 6 illustrates a computing system 500 in which a computer readable medium 506 may provide instructions for performing any of the methods disclosed herein.
- the invention can take the form of a computer program product accessible from the computer readable medium 506 providing program code for use by or in connection with a computer or any instruction execution system.
- the computer readable medium 506 can be any apparatus that can tangibly store the program for use by or in connection with the instruction execution system, apparatus, or device, including the computer system 500 .
- the medium 506 can be any tangible electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device).
- Examples of a computer readable medium 506 include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk.
- Some examples of optical disks include compact disk-read only memory (CD-ROM), compact disk-read/write (CD-R/W) and DVD.
- the computing system 500 can include one or more processors 502 coupled directly or indirectly to memory 508 through a system bus 510 .
- the memory 508 can include local memory employed during actual execution of the program code, bulk storage, and cache memories which provide temporary storage of at least some program code in order to reduce the number of times code is retrieved from bulk storage during execution.
- I/O devices 504 can be coupled to the system either directly or through intervening I/O controllers.
- Network adapters may also be coupled to the system to enable the computing system 500 to become coupled to other data processing systems, such as through host systems interfaces 512 , or remote printers or storage devices through intervening private or public networks. Modems, cable modem and Ethernet cards are just a few of the currently available types of network adapters.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Information Transfer Systems (AREA)
- Stored Programmes (AREA)
Abstract
Description
- This document claims priority to and thus the benefit of an earlier filing date from U.S. Provisional Patent Application No. 61/862,361 (filed on Aug. 5, 2013, entitled “Multi-Protocol Storage Controller”), which is hereby incorporated by reference.
- The invention generally relates to field of storage controllers.
- Numerous storage device interfaces exist and continually challenge storage domains. For example, Peripheral Component Interconnect Express protocol (PCIe) based storage devices are now being used in association with Serial Attached Small Computer System Interface (SAS) storage domains. And, in some instances, PCIe storage devices are “hot-swapped” in place of SAS storage devices. But, PCIe is a packet based, connectionless transfer protocol and SAS is an end-to-end, connection based protocol that does not provide for connectionless transfers, making interoperability particularly challenging. More particularly though, storage controllers employing one protocol are incapable of detecting storage devices of another protocol when hot swapped into the domain.
- Systems and methods presented herein provide for coupling a storage controller to a plurality of different storage device types. In one embodiment, a storage controller includes an interface operable to communicatively couple to a storage device. The storage controller also includes a processor operable to select between hardware protocol detection of the storage device and firmware protocol detection of the storage device, and to detect a protocol of the storage device when the storage device communicatively couples to the interface according to the selected protocol detection. The storage controller then selects a protocol to process input/output requests from a host based on the detected protocol of the storage device.
- The various embodiments disclosed herein may be implemented in a variety of ways as a matter of design choice. For example, the embodiments may take the form of computer hardware, software, firmware, or combinations thereof. Other exemplary embodiments are described below.
- Some embodiments of the present invention are now described, by way of example only, and with reference to the accompanying drawings. The same reference number represents the same element or the same type of element on all drawings.
-
FIG. 1 is a block diagram of an exemplary storage controller operable with devices of differing protocols. -
FIG. 2 is a flowchart of an exemplary process of the storage controller ofFIG. 1 . -
FIG. 3 is a block diagram of another exemplary storage controller. -
FIG. 4 is a flowchart of an exemplary process of the storage controller ofFIG. 3 . -
FIG. 5 is a graph of an exemplary hardware protocol detection scheme of the storage controllers ofFIGS. 1 and 3 . -
FIG. 6 is a flowchart of another exemplary process of the storage controller ofFIG. 3 . -
FIG. 7 is a block diagram of an exemplary computing system in which a computer readable medium provides instructions for performing methods herein. - The figures and the following description illustrate specific exemplary embodiments of the invention. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the invention and are included within the scope of the invention. Furthermore, any examples described herein are intended to aid in understanding the principles of the invention and are to be construed as being without limitation to such specifically recited examples and conditions. As a result, the invention is not limited to the specific embodiments or examples described below.
-
FIG. 1 is a block diagram of anexemplary storage controller 104 operable with devices of differing protocols. Thestorage controller 104 is operable to process I/O requests of ahost system 105 and direct those I/O requests tovarious target devices target devices 110 are SAS storage devices, thetarget devices 111 are PCIe storage devices, and thetarget device 112 is a storage device using some other protocol (e.g., a Serial Attached AT Attachment (SATA) protocol, a Fibre Channel over Internet Protocol protocol, an Enterprise Systems Connection, a Fibre Channel protocol, a Universal Serial Bus (USB) protocol, an Internet Serial Attached Small Computer System Interface (ISCSI) protocol, etc.). Thestorage controller 104 is operable to discover, via hardware and/or firmware, the type of storage device it connects to when one of thetarget devices storage controller 104. Once discovered, thestorage controller 104 can process I/O requests from thehost system 105 to any of thetarget devices - The
target devices storage controller 104 or they may be coupled through a storage system expansion component, such as theexpander 103. For example, one or more expanders may be operable to directly attach toother target devices storage controller 104. An example of theexpander 103 includes a wide port expander operable with multiple protocols, such as those mentioned (e.g., SAS, PCIe, USB, SATA, etc.). - Examples of the
target devices target devices host system 105. And, thehost system 105 may configure read/write requests for input/output (I/O) operations with any of thetarget devices host system 105 may be any suitable computing device or system operable to perform I/O operations, for example, servers, workstations, personal computers, etc. - The
storage controller 104 is any device, system, software, or combination thereof operable to perform device discovery, manage I/O requests to thetarget devices storage controller 104 may be implemented as custom circuitry, as a special or general purpose processor executing programmed instructions stored in an associated program memory, or some combination thereof. Thestorage controller 104 may be an independent SAS device, a Host Bus Adapter (HBA) of a host, or an integrated component of thehost system 105. - The
storage controller 104 includes a frontend interface adapted to couple to and receive I/O requests of thehost system 105. Thestorage controller 104 also includes a backend interface (shown and described in greater detail below) that is adapted to couple to and support PCIe devices (e.g., PCIe compatible expanders, PCIe switches, and PCIe target devices 111), SAS devices (e.g.,SAS target devices 110 and SAS expanders), and others. - The
expander 103 is any device, system, software, or combination thereof operable to expand a storage system via possible connections to multiple storage devices. In this regard, theexpander 103 may connect to SAS components, such asSAS target devices 110 and other expanders via a plurality of physical transceivers, or “Phys”. More particularly, theexpander 103 may be operable to directly attach to a plurality of target devices via a number of different protocols, such as those mentioned (e.g., SAS, PCIe, USB, SATA, etc.) and may utilize the protocol detection methods present in thestorage controller 104. - Although shown and described with respect to a certain number of expanders and target devices, the invention is not intended to be limited to any particular number of components or their illustrated connections. Certain operational details of the
storage controller 104 are now discussed with respect to the flowchart ofFIG. 2 . -
FIG. 2 is a flowchart of anexemplary process 200 operable with thestorage controller 104 ofFIG. 1 . Theprocess 200 initiates when thestorage controller 104 communicatively couples to a storage device, in theprocess element 201. For example, when one of thetarget devices storage controller 104, either directly or indirectly (e.g., via the expander 103), thestorage controller 104 begins a hardware discovery and/or a firmware discovery of the target device. In this regard, thestorage controller 104 selects between a hardware protocol detection of the storage device and a firmware protocol detection of the storage device, in theprocess element 202. - Once the detection scheme is selected, the storage controller automatically begins detecting the protocol of the storage device, in the
process element 203. For example, a hardware detection scheme may be employed by thestorage controller 104 to determine the protocol of the storage device when it couples to an interface of the storage controller via hardware signaling and/or time domain reflectometry. If the storage device is not detected via the hardware protocol detection scheme, thestorage controller 104 may fail over to a firmware detection scheme by attempting link establishment via various protocols until the storage device responds. Thestorage controller 104 may, however, also be configured to initiate from a firmware protocol detection scheme and failover to a hardware protocol detection scheme or even be configured to only use one or the other detection schemes to detect the protocol of the attached storage device. - Once the protocol of the storage device is detected, the
storage controller 104 selects a protocol to process I/O requests from thehost system 105, in theprocess element 204. For example, thestorage controller 104 may be configured with a variety of protocol stacks. Once the protocol of the storage device is detected, thestorage controller 104 processes the I/O requests from thehost system 105 through the appropriate protocol stack. -
FIG. 3 is a block diagram of anotherexemplary storage controller 104. In this embodiment, thestorage controller 104 is configured with asystem interface 301 that is operable to communicatively and physically couple thestorage controller 104 to the physical interface of thehost system 105 and process I/O requests according to PCIe and SAS/SATA protocol stacks. The PCIe stack comprises PCIeupper layers 302, aPCIe link layer 304, and a PCIephysical layer 306, or Phy. The SAS/SATA stack comprises SAS/SATAupper layers 303, a SAS/SATA link layer 305, and a SAS/SATAphysical layer 307, or Phy. - The
storage controller 104 also comprisesprotocol selection logic 308 that is operable to select the appropriate protocol stack when the protocol of the storage device is detected. Aprotocol multiplexer 309 is communicatively coupled to theprotocol selection logic 308 to control which of the protocol stacks will be used when the protocol the storage device is detected. - The
protocol selection logic 308 and associatedprotocol multiplexer 309 work in conjunction to choose whether the storage device's physical interface connects to the PCIe protocol stack or the SAS/SATA protocol stack. The serial/deserializer (SerDes) 310 is operable to perform a hardware protocol detection of the attached storage device. Indication of successful link establishment is passed from both thePCIe link layer 304 and the SAS/SATA link layer 307 to ensure that theprotocol multiplexer 309 remains fixed on a currently selected protocol when success is achieved. In some embodiments, a particular protocol's link and Phy layers (e.g.,PCIe link layer 304,PCIe Phy layer 306, SAS/SATA link layer 305, SAS/SATA Phy layer 307) are enabled when theprotocol multiplexer 309 is currently selecting that protocol so as to minimize power consumption. For example, power can be reduced by quiescing an unused protocol stack of thestorage controller 104 and turning off a clock in thestorage controller 104. This prevents MOS gates from toggling, which can contribute to a significant waster of power in semiconductors due to switching of the capacitive loads of the gates. - In another embodiment, a loss of signal indication from the
SerDes 310 is used directly by the SAS/SATA Phy layer 307 even when theprotocol multiplexer 309 is currently selecting PCIe protocol to allow a rapid switch over to SAS/SATA protocol in the event that valid SAS/SATA Out Of Band (OOB) signals are detected. For example, theprotocol multiplexer 309 may be directed by theprotocol selection logic 308 to select the PCIe protocol stack for communication with the attached storage device. However, the attached storage device may be a SAS/SATA storage device. Thestorage controller 104 may be operable to more quickly hardware detect the OOB signals of the SAS/SATA device while the PCIe protocol stack is attempting to communicate with the attached storage device. In this regard, the detection of OOB signals may actually take place in the SAS/SATA Phy layer 307. TheSerDes 310 provides loss of signal indication to the SAS/SATA Phy layer 307 which, in turn, looks for a proper OOB pattern. Theprotocol selection logic 308 then selects the SAS/SATA protocol stack and ceases attempts by the PCIe protocol stack to communicate with the attached storage device. - The automatic OOB detection process can be provided in parallel to the detection of progress on the
PCIe link layer 304. In the event that PCIe is not making progress and a valid SAS/SATA OOB signal is received by theSerDes 310, theprotocol multiplexer 309 switches over to SAS/SATA control (i.e., the SAS/SATA protocol stack) such that an OOB signal may be sent in reply to the attached storage device. Even if no PCIe or SAS/SATA activity is present, theprotocol multiplexer 309 may periodically switch to the SAS/SATA protocol stack to send an OOB signal to comply with the Hotplug timeout requirements of the T10 SAS standards (T10 is the technical committee that establishes the standards for SCSI, SATA, and SAS). An example of this detection is shown and described in the flowchart ofFIG. 6 . - In any case, an indication of a successful link being established may be passed from the
PCIe link layer 304 to the SAS/SATA link layer 305 via theprotocol selection logic 308, and vice versa, such that theprotocol selection logic 308 halts any further attempts to switch protocols (e.g., by alerting the firmware of thestorage controller 104 to the successful result via an interrupt or some other means). - The manner in which a particular protocol detection scheme is selected in the
storage controller 104 may be performed in a number of ways.FIG. 4 is a flowchart of one such exemplary process of protocol detection selection by thestorage controller 104. More specifically, a programmable protocol selection method is illustrated inFIG. 4 that provides the firmware of thestorage controller 104 with the ability to choose the protocol based on a priori knowledge of the system configuration. For example, thestorage controller 104 may enable firmware protocol detection, in theprocess element 351, such that firmware attempts to initiate communication with the attached storage device before or in parallel with hardware detection. The storage device being attached to thestorage controller 104 may be known such that the firmware of thestorage controller 104 can automatically initiate protocol detection via a predetermined firmware selection of the protocol, in theprocess element 352. In this regard, the firmware of thestorage controller 104 may automatically choose the PCIe protocol, in theprocess element 354, if the device is known to be a PCIe storage device or the SAS/SATA protocol if the device is known to be a SAS/SATA storage device, in theprocess element 355. - Alternatively, the firmware protocol detection of the
process element 352 may provide thestorage controller 104 with the ability to cycle through the available protocols of thestorage controller 104 until a connection is made with the attached storage device. For example, the firmware may alternate between protocols looking for a “PhyReady” SAS/SATA condition or a “LinkUp” PCIe condition. In either case, the firmware of thestorage controller 104 chooses either PCIe or SAS/SATA operation, and theprotocol multiplexer 309 is set to the appropriate protocol until the firmware of thestorage controller 104 changes the configuration. - If the firmware protocol detection of the
process element 351 is disabled, thestorage controller 104 would generally implement a hardware protocol detection in theprocess element 356. The hardware sensed protocol detection of theprocess element 356 mode may be enabled if thestorage controller 104 firmware has no knowledge of the protocol to expect and decides to not cycle between the protocols. Once the hardware sensed protocol detection successfully achieves a PhyReady or LinkUp state with a particular protocol, any further protocol switching is suspended until it is enabled again by firmware. If the hardware sensed protocol detection of theprocess element 356 is disabled, theprotocol multiplexer 309 may be held in an idle position such that no protocol stack is selected. For example, both the PCIe and SAS protocol stacks of thestorage controller 104 in this respect would remain quiescent. - If the hardware sensed protocol detection of the
process element 356 is enabled, thestorage controller 104 may be configured to cycle through protocol stacks (process element 358), automatically detect the protocol of the OOB signals (process element 359), and/or transmit a pulse and analyze the reflected wave via time domain reflectometry, or “TDR”, (process element 360). To illustrate, theprotocol multiplexer 309 may alternate between PCIe and SAS/SATA protocol stacks with a programmable dwell time for each protocol until success for any protocol is achieved, in theprocess element 358. After a successful connection via a particular protocol is established, an interrupt directs thestorage controller 104 to begin processing I/O requests according to the protocol of the storage device. Generally, all channels associated with a ×2, ×4, ×8, or ×16 PCIe configuration should alternate simultaneously, and thePCIe Link Layer 304 automatically detects a lane reversal condition during the training sequence such that there is no need to cycle through different lane reversal configurations. - In the
process element 359, theprotocol multiplexer 309 may be configured to default to thePCIe Phy layer 306, but a loss of signal indication, such as an RXLOS signal, would still be transferred to the SAS/SATA Phy layer 307 to support OOB sequence detection. Then, if thestorage controller 104 is able to successfully establish a link via the PCIe protocol (e.g., “LinkUp”), theprotocol multiplexer 309 locks into the PCIe protocol stack of thestorage controller 104. If, however, the SAS/SATA Phy layer 307 detects a valid COMINIT OOB sequence of the SAS/SATA protocol, then theprotocol multiplexer 309 switches to the SAS/SATA Phy layer 307 such that the SAS/SATA Phy layer 307 may send a COMINIT to the attached storage device. If no protocol is successful within a programmable Hotplug timeout period (typically 10-500 ms), then thestorage controller 104 may automatically select the SAS/SATA Phy layer 307 by sending a COMINIT to the storage device in an attempt to “brute force” connect to the storage device. Alternatively, thestorage controller 104 may simply continue monitoring or perform an alternative protocol detection scheme. - In the
process element 360, theSerDes 310 periodically sends a pulse and analyzes the reflected wave to detect a distinct AC coupling characteristic which indicates the protocol of the attached device. For example, the storage device, based on its standardized storage protocol electrical requirements, has a particular analog signaling characteristic. A TDR pulse transmitted to the storage device would be reflected back to theSerDes 310 and analyzed by thestorage controller 104 to determine the type of storage device that is coupled to thestorage controller 104. An example of such hardware/TDR detection is shown and described below inFIG. 5 . -
FIG. 5 is agraph 370 of an exemplary hardware detection scheme of thestorage controllers 104. One particular challenge in sensing PCIe versus SAS electrical characteristics is the broad range of passive channel lengths employed in SAS. SAS channel lengths may range from just a few centimeters to as many as 10 meters, which can induce a delay in a reflected TDR wave of many 10 s of nanoseconds (e.g., illustrated as “time of flight ×2”). - A sample timer (373) may be implemented by the
SerDes 310 to determine when to sample the reflected wave and make an assessment of the charge characteristic. Such a timer may be configured to start when the TDR pulse is launched (i.e., the bolder line 371). Alternatively, an accurate measurement of the charge characteristic of the pulse in a SAS channel with unknown length could be obtained with a threshold (372) being used to detect the reflected TDR pulse from the SAS channel arriving back at theSerDes 310. Another alternative would include a dV/dt receiver being used to detect the arrival of the reflected TDR pulse. Once the reflected TDR pulse arrives, the sample timer would be started (373). When the sample timer expires, the voltage at theSerDes 310 can be sampled (e.g., sample points 380) and compared to various threshold voltages (e.g., 372, 374, 375). For example, if a SAS charge detection threshold is exceeded, the TDR pulse would indicate that a SAS Device is attached to thestorage controller 104. Otherwise, the TDR pulse would indicate that a PCIe storage device is attached or that no devices attached at all (375). Such thresholds could be programmed into the firmware of thestorage controller 104 to provide flexibility in different implementations and operating environments. - In another embodiment, a failsafe timer may be used to determine the type of storage device that is attached to the
storage controller 104. For example, at a launch of TDR pulse (371), a failsafe timer set to twice the maximum cable length delay may be started. If a reflected TDR pulse is detected, the sample timer would be triggered and sampling (e.g., sample points 380) of the charge value would occur. If no reflected TDR pulse is observed, sampling of the charge value would occur when the fail safe timer expires. For example, if a link is properly terminated, then there is no reflection and the fail safe timer would start. If the link is not terminated, then the reflection triggers the detection automatically at a time based on twice the delay of the maximum length of the transmission line. - Alternatively, a baseline timer (376) could be used in conjunction with the failsafe timer to make an assessment of a charge slope (e.g., 390, 391, 392) based on sampling rather than basing the assessment purely on absolute voltage thresholds. For example, the baseline timer may be used to sample the reflected TDR pulse shortly after the TDR pulse has been received. The baseline timer may capture the first point in determining the charge slope. Thereafter, the sample timer can be used to capture the second point from which the charge slope may be determined. Multiple samples may of course be used to improve accuracy and improve noise immunity (i.e., more accurately determine what is signal and what is noise).
- This reflected TDR pulse detection technique for starting the sample timer provides flexibility for channels of a variety of lengths, including those beyond the 10 meter passive length limit of SAS. Additional thresholds could also be employed to provide finer discrimination of charge characteristics associated with the various protocols. An analog-to-digital converter could be employed to perform the detection with the charge level being determined via numeric comparison. Additional accuracy could be achieved by taking multiple samples during the charge time and performing numerical analysis and curve fitting on the
resultant sample points 380 prior to making a determination on the charge characteristic. -
FIG. 6 is a flowchart of anotherexemplary process 400 of thestorage controller 104. Theprocess 400 illustrates hysteresis in a selected protocol. In the event that a link is dropped, thestorage controller 104 can attempt to reestablish the link with a most recently used protocol. Such may be useful for cases where a link is reset due to firmware-directed reinitialization when a new device is not actually installed. For example, the firmware resets thestorage controller 104, in theprocess element 401, and connection to a storage device is then lost. Thestorage controller 104 may then perform a receiver detect sequence to acquire a previously attached PCIe device after initialization of thestorage controller 104, in theprocess element 402. Thestorage controller 104 may perform this operation a number of times after some delay (process element 403) until the PCIe device is detected, in theprocess element 404. For example, thestorage controller 104 may be configured to attempt detection of the attached storage device some predetermined number of times before switching to another form of protocol detection. - Once the PCIe device is detected, the storage controller selects the PCIe protocol stack to set the PCIe mode of the
storage controller 104, in theprocess element 405. Thestorage controller 104 then enables the PCIe link initialization of thePCIe link layer 304, in theprocess element 406. Afterwards, thestorage controller 104 makes a determination as to whether the PCIe initialization is making progress, in theprocess element 407. - If the PCIe initialization is making progress, the
storage controller 104 initiates a PCIe progress timer, in theprocess element 408, looping through until a link is established with the PCIe device, in the process element 409. Once the link is established, the storage controller initiates a Hotplug timer to determine if the PCIe device is ready to communicate with thestorage controller 104, in theprocess elements storage controller 104 may attempt to establish a connection by re-initiating the receiver detect sequence of theprocess element 402. But, as long as a link is up, the Hotplug timer continues to be reset. If the link drops, the Hotplug timer continues running so that there is only so much time given to try and reestablish the link with that particular protocol. If the Hotplug timer eventually expires (e.g., process elements 413 and 422), then thestorage controller 104 attempts communication via another protocol. - If the PCIe initialization is not making progress, the
storage controller 104 determines whether the Hotplug timer initiated in theprocess element 410 has expired, in process element 413. If not, theSerDes 310 determines whether the SAS OOB signal has been detected, in theprocess element 414. If not, thestorage controller 104 returns to theprocess element 407 to determine whether the PCIe initialization is making progress. If the Hotplug timer has expired or the SAS OOB signal has been detected, thestorage controller 104 selects the SAS/SATA protocol stack to establish the SAS/SATA mode of thestorage controller 104, in theprocess element 415. In this regard, thestorage controller 104 enables SAS/SATA link initialization of the SAS/SATA link layer 305, in theprocess element 416, thereby making the decision to abandon PCIe initialization. - Once the
link layer 305 is enabled, thestorage controller 104 determines whether the SAS initialization has begun and is making progress, in theprocess element 417. If so, thestorage controller 104 initiates a SAS initialization progress timer, in the process element 418, and determines whether the SAS/SATA link is established, in theprocess element 419. For example, the SAS initialization progress timer may establish a certain amount of time for thestorage controller 104 to link to the storage device, assuming that it is a SAS storage device. If the link is not established within that amount of time, thestorage controller 104 may return to theprocess element 417 to determine whether the SAS initialization is making progress or not. - If the SAS/SATA link is established with the SAS/
SATA link layer 305, then thestorage controller 104 initiates the Hotplug timer in theprocess element 420 and determines whether the link is ready in theprocess element 421. If the link is not ready, thestorage controller 104 may return to theprocess element 417 to determine whether the SAS initialization is making progress. If so, thestorage controller 104 may continually initialize the Hotplug timer while the link is up. Otherwise, thestorage controller 104 may determine that the link is not ready and attempt to reenable the SAS/SATA link initialization in theprocess element 416. If the SAS initialization is not making progress (i.e., process element 417), then thestorage controller 104 determines whether the Hotplug timer has expired, in the process element 422. If not, thestorage controller 104 may continue waiting for SAS initialization until the Hotplug timer expires. When the timer does indeed expire, thestorage controller 104 returns to processelement 402 to perform another receiver detection sequence (e.g., select another protocol stack, protocol detection scheme, quit detection altogether, etc.). - The above embodiments provide several advantages over current protocol detection schemes. For example, the above embodiments provide for dynamically or statically configuring protocol detections capable of detecting any of a variety of protocols. While two protocol stacks are illustrated, the invention is not to be limited to such. The
storage controller 104 may be configured with a variety of protocol stacks that allow the storage controller to couple to and communicate with a variety target devices. The protocol detection schemes include cycling through protocols performing parallel protocol detection of OOB signaling of the SAS protocol, and passive protocol detection via hardware sensing electrical characteristics of the attached devices. - The invention can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment containing both hardware and software elements. In one embodiment, the invention is implemented in software, which includes but is not limited to firmware, resident software, microcode, etc.
FIG. 6 illustrates acomputing system 500 in which a computerreadable medium 506 may provide instructions for performing any of the methods disclosed herein. - Furthermore, the invention can take the form of a computer program product accessible from the computer
readable medium 506 providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, the computerreadable medium 506 can be any apparatus that can tangibly store the program for use by or in connection with the instruction execution system, apparatus, or device, including thecomputer system 500. - The medium 506 can be any tangible electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device). Examples of a computer
readable medium 506 include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk. Some examples of optical disks include compact disk-read only memory (CD-ROM), compact disk-read/write (CD-R/W) and DVD. - The
computing system 500, suitable for storing and/or executing program code, can include one ormore processors 502 coupled directly or indirectly tomemory 508 through asystem bus 510. Thememory 508 can include local memory employed during actual execution of the program code, bulk storage, and cache memories which provide temporary storage of at least some program code in order to reduce the number of times code is retrieved from bulk storage during execution. Input/output or I/O devices 504 (including but not limited to keyboards, displays, pointing devices, etc.) can be coupled to the system either directly or through intervening I/O controllers. Network adapters may also be coupled to the system to enable thecomputing system 500 to become coupled to other data processing systems, such as through host systems interfaces 512, or remote printers or storage devices through intervening private or public networks. Modems, cable modem and Ethernet cards are just a few of the currently available types of network adapters.
Claims (22)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/964,670 US8943234B1 (en) | 2013-08-05 | 2013-08-12 | Multi-protocol storage controller |
JP2014117155A JP2015032304A (en) | 2013-08-05 | 2014-06-06 | Multi-protocol storage controller |
TW103123206A TWI534626B (en) | 2013-08-05 | 2014-07-04 | Storage controller, method operable in a storage controller and non-transitory computer readable medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361862361P | 2013-08-05 | 2013-08-05 | |
US13/964,670 US8943234B1 (en) | 2013-08-05 | 2013-08-12 | Multi-protocol storage controller |
Publications (2)
Publication Number | Publication Date |
---|---|
US8943234B1 US8943234B1 (en) | 2015-01-27 |
US20150039787A1 true US20150039787A1 (en) | 2015-02-05 |
Family
ID=51133896
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/964,670 Active US8943234B1 (en) | 2013-08-05 | 2013-08-12 | Multi-protocol storage controller |
Country Status (5)
Country | Link |
---|---|
US (1) | US8943234B1 (en) |
EP (1) | EP2838031B1 (en) |
JP (1) | JP2015032304A (en) |
KR (1) | KR101575502B1 (en) |
TW (1) | TWI534626B (en) |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160050335A1 (en) * | 2014-08-14 | 2016-02-18 | Canon Kabushiki Kaisha | Information processing apparatus, and control method of information processing apparatus |
US20160239458A1 (en) * | 2015-02-17 | 2016-08-18 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Devices with asymmetric sas generation support |
US20170322898A1 (en) * | 2016-05-06 | 2017-11-09 | Quanta Computer Inc. | Systems and methods for flexible hdd/ssd storage support |
CN107463521A (en) * | 2016-06-06 | 2017-12-12 | 瑞昱半导体股份有限公司 | Solid state hard disc control device and method |
WO2019005391A1 (en) * | 2017-06-30 | 2019-01-03 | Intel Corporation | Techniques to support multiple protocols between computer system interconnects |
US10218638B2 (en) | 2016-07-26 | 2019-02-26 | International Business Machines Corporation | Adaptive mechanism for efficient user credentials identification in a dynamic hardware environment |
US20190146933A1 (en) * | 2016-06-01 | 2019-05-16 | Realtek Semiconductor Corporation | Solid state drive control device and method |
US10387351B2 (en) * | 2017-12-22 | 2019-08-20 | Fend, Inc. | One-way data transfer device with onboard system detection |
US10474613B1 (en) | 2017-12-22 | 2019-11-12 | Fend, Inc. | One-way data transfer device with onboard system detection |
TWI685748B (en) * | 2018-11-19 | 2020-02-21 | 神雲科技股份有限公司 | Hdd control system |
CN111240914A (en) * | 2020-01-07 | 2020-06-05 | 福建新大陆支付技术有限公司 | Hardware information detection method, system and device based on Android equipment |
US10776299B2 (en) | 2015-05-08 | 2020-09-15 | Samsung Electronics Co., Ltd. | Multi-protocol I/O infrastructure for a flexible storage platform |
US10909047B2 (en) * | 2016-06-01 | 2021-02-02 | Raymx Microelectronics Corp. | Flash memory control device capable of detecting type of interface and method thereof |
US11153345B1 (en) * | 2020-05-20 | 2021-10-19 | Fend Incorporated | One-way transfer device with secure reverse channel |
US11249808B2 (en) | 2017-08-22 | 2022-02-15 | Intel Corporation | Connecting accelerator resources using a switch |
US11709970B1 (en) | 2022-12-19 | 2023-07-25 | Fend Incorporated | One-way communication data diode on a chip |
US11811609B2 (en) | 2018-05-04 | 2023-11-07 | International Business Machines Corporation | Storage target discovery in a multi-speed and multi-protocol ethernet environment |
US20230367729A1 (en) * | 2015-03-27 | 2023-11-16 | Intel Corporation | Dynamic configuration of input/output controller access lanes |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016167378A1 (en) * | 2015-04-13 | 2016-10-20 | 주식회사 로보티즈 | Device for supporting connection between host and client devices concerning plurality of kinds of physical layers |
US11983138B2 (en) * | 2015-07-26 | 2024-05-14 | Samsung Electronics Co., Ltd. | Self-configuring SSD multi-protocol support in host-less environment |
US10372659B2 (en) | 2016-07-26 | 2019-08-06 | Samsung Electronics Co., Ltd. | Multi-mode NMVE over fabrics devices |
US10346041B2 (en) | 2016-09-14 | 2019-07-09 | Samsung Electronics Co., Ltd. | Method for using BMC as proxy NVMeoF discovery controller to provide NVM subsystems to host |
US10210123B2 (en) | 2016-07-26 | 2019-02-19 | Samsung Electronics Co., Ltd. | System and method for supporting multi-path and/or multi-mode NMVe over fabrics devices |
US20190109720A1 (en) | 2016-07-26 | 2019-04-11 | Samsung Electronics Co., Ltd. | Modular system (switch boards and mid-plane) for supporting 50g or 100g ethernet speeds of fpga+ssd |
US11144496B2 (en) | 2016-07-26 | 2021-10-12 | Samsung Electronics Co., Ltd. | Self-configuring SSD multi-protocol support in host-less environment |
US11461258B2 (en) | 2016-09-14 | 2022-10-04 | Samsung Electronics Co., Ltd. | Self-configuring baseboard management controller (BMC) |
TWI607317B (en) * | 2016-10-26 | 2017-12-01 | 神雲科技股份有限公司 | Computer system |
US10585831B2 (en) | 2017-01-27 | 2020-03-10 | Hewlett Packard Enterprise Development Lp | PCIe connectors |
JP2019096007A (en) * | 2017-11-21 | 2019-06-20 | 富士ゼロックス株式会社 | Electronic device and image formation system |
TWI639921B (en) | 2017-11-22 | 2018-11-01 | 大陸商深圳大心電子科技有限公司 | Command processing method and storage controller using the same |
KR20200014991A (en) | 2018-08-02 | 2020-02-12 | 사단법인 엑시콘산학공동연구소 | Storage protocol matching device and method thereof |
CN110275680B (en) * | 2019-06-24 | 2020-12-01 | 浙江大华技术股份有限公司 | Double-control double-active storage system |
US11281399B2 (en) * | 2020-06-24 | 2022-03-22 | Western Digital Technologies, Inc. | Dual-interface storage system and method for use therewith |
US11442665B2 (en) | 2020-12-04 | 2022-09-13 | Western Digital Technologies, Inc. | Storage system and method for dynamic selection of a host interface |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050138191A1 (en) * | 2003-12-18 | 2005-06-23 | Pak-Lung Seto | Adaptor supporting different protocols |
US20070226360A1 (en) * | 2006-03-09 | 2007-09-27 | Sun Microsystems, Inc. | Multi-protocol iSCSI device discovery for on demand device enumeration |
US20130232376A1 (en) * | 2012-03-05 | 2013-09-05 | International Business Machines Corporation | Managing A Storage Device Using A Hybrid Controller |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3335070B2 (en) * | 1996-05-16 | 2002-10-15 | シャープ株式会社 | Communication terminal device |
US6530062B1 (en) * | 2000-03-10 | 2003-03-04 | Rambus Inc. | Active impedance compensation |
US7093033B2 (en) | 2003-05-20 | 2006-08-15 | Intel Corporation | Integrated circuit capable of communicating using different communication protocols |
US7363395B2 (en) * | 2003-12-31 | 2008-04-22 | Intel Corporation | Intermediate device capable of communicating using different communication protocols |
US7719992B1 (en) * | 2004-07-14 | 2010-05-18 | Cisco Tchnology, Ink. | System for proactive time domain reflectometry |
US7743197B2 (en) * | 2006-05-11 | 2010-06-22 | Emulex Design & Manufacturing Corporation | System and method for virtualizing PCIe devices |
US7917682B2 (en) | 2007-06-27 | 2011-03-29 | Emulex Design & Manufacturing Corporation | Multi-protocol controller that supports PCIe, SAS and enhanced Ethernet |
CN101335736B (en) * | 2007-06-28 | 2011-05-25 | 联想(北京)有限公司 | High-speed peripheral interconnecting interface |
US8447892B1 (en) | 2007-09-27 | 2013-05-21 | Emc Corporation | PCI-E extended reach with receive detect circuitry |
US8874820B2 (en) | 2010-12-28 | 2014-10-28 | Silicon Image, Inc. | Mechanism for facilitating a configurable port-type peripheral component interconnect express/serial advanced technology attachment host controller architecture |
-
2013
- 2013-08-12 US US13/964,670 patent/US8943234B1/en active Active
-
2014
- 2014-06-06 JP JP2014117155A patent/JP2015032304A/en not_active Ceased
- 2014-07-02 EP EP14175467.1A patent/EP2838031B1/en active Active
- 2014-07-04 TW TW103123206A patent/TWI534626B/en not_active IP Right Cessation
- 2014-07-04 KR KR1020140083829A patent/KR101575502B1/en active IP Right Grant
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050138191A1 (en) * | 2003-12-18 | 2005-06-23 | Pak-Lung Seto | Adaptor supporting different protocols |
US20070226360A1 (en) * | 2006-03-09 | 2007-09-27 | Sun Microsystems, Inc. | Multi-protocol iSCSI device discovery for on demand device enumeration |
US20130232376A1 (en) * | 2012-03-05 | 2013-09-05 | International Business Machines Corporation | Managing A Storage Device Using A Hybrid Controller |
Cited By (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10075609B2 (en) * | 2014-08-14 | 2018-09-11 | Canon Kabushiki Kaisha | Information processing apparatus and control method thereof for reducing transition time from a power-save mode |
US20160050335A1 (en) * | 2014-08-14 | 2016-02-18 | Canon Kabushiki Kaisha | Information processing apparatus, and control method of information processing apparatus |
US20160239458A1 (en) * | 2015-02-17 | 2016-08-18 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Devices with asymmetric sas generation support |
US9953005B2 (en) * | 2015-02-17 | 2018-04-24 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Devices with asymmetric SAS generation support |
US20230367729A1 (en) * | 2015-03-27 | 2023-11-16 | Intel Corporation | Dynamic configuration of input/output controller access lanes |
US11907150B2 (en) | 2015-05-08 | 2024-02-20 | Samsung Electronics Co., Ltd. | Multi-protocol IO infrastructure for a flexible storage platform |
US11003609B2 (en) | 2015-05-08 | 2021-05-11 | Samsung Electronics Co., Ltd. | Multi-protocol IO infrastructure for a flexible storage platform |
US10776299B2 (en) | 2015-05-08 | 2020-09-15 | Samsung Electronics Co., Ltd. | Multi-protocol I/O infrastructure for a flexible storage platform |
US10691628B2 (en) * | 2016-05-06 | 2020-06-23 | Quanta Computer Inc. | Systems and methods for flexible HDD/SSD storage support |
US20170322898A1 (en) * | 2016-05-06 | 2017-11-09 | Quanta Computer Inc. | Systems and methods for flexible hdd/ssd storage support |
US20190146933A1 (en) * | 2016-06-01 | 2019-05-16 | Realtek Semiconductor Corporation | Solid state drive control device and method |
US20190361819A1 (en) * | 2016-06-01 | 2019-11-28 | RayMX Microelectronics, Corp. | Apparatus For Adapting Interface Type Of Peripheral Device And Method Thereof |
US10909047B2 (en) * | 2016-06-01 | 2021-02-02 | Raymx Microelectronics Corp. | Flash memory control device capable of detecting type of interface and method thereof |
US10817437B2 (en) * | 2016-06-01 | 2020-10-27 | Raymx Microelectronics Corp. | Solid state drive control device and method |
US10776288B2 (en) | 2016-06-01 | 2020-09-15 | Raymx Microelectronics Corp. | Apparatus for adapting interface type of peripheral device and method thereof |
CN107463521B (en) * | 2016-06-06 | 2020-09-01 | 合肥沛睿微电子股份有限公司 | Solid state disk control device and method |
CN107463521A (en) * | 2016-06-06 | 2017-12-12 | 瑞昱半导体股份有限公司 | Solid state hard disc control device and method |
US10218638B2 (en) | 2016-07-26 | 2019-02-26 | International Business Machines Corporation | Adaptive mechanism for efficient user credentials identification in a dynamic hardware environment |
WO2019005391A1 (en) * | 2017-06-30 | 2019-01-03 | Intel Corporation | Techniques to support multiple protocols between computer system interconnects |
US11095556B2 (en) * | 2017-06-30 | 2021-08-17 | Intel Corporation | Techniques to support multiple protocols between computer system interconnects |
US11729096B2 (en) * | 2017-06-30 | 2023-08-15 | Intel Corporation | Techniques to support multiple protocols between computer system interconnects |
US20210399982A1 (en) * | 2017-06-30 | 2021-12-23 | Intel Corporation | Techniques to support multiple protocols between computer system interconnects |
US11249808B2 (en) | 2017-08-22 | 2022-02-15 | Intel Corporation | Connecting accelerator resources using a switch |
US10474613B1 (en) | 2017-12-22 | 2019-11-12 | Fend, Inc. | One-way data transfer device with onboard system detection |
US10387351B2 (en) * | 2017-12-22 | 2019-08-20 | Fend, Inc. | One-way data transfer device with onboard system detection |
US11811609B2 (en) | 2018-05-04 | 2023-11-07 | International Business Machines Corporation | Storage target discovery in a multi-speed and multi-protocol ethernet environment |
TWI685748B (en) * | 2018-11-19 | 2020-02-21 | 神雲科技股份有限公司 | Hdd control system |
CN111240914A (en) * | 2020-01-07 | 2020-06-05 | 福建新大陆支付技术有限公司 | Hardware information detection method, system and device based on Android equipment |
US20210367973A1 (en) * | 2020-05-20 | 2021-11-25 | Fend Incorporated | One-way transfer device with secure reverse channel |
US11627161B2 (en) * | 2020-05-20 | 2023-04-11 | Fend Incorporated | One-way transfer device with secure reverse channel |
US11601472B2 (en) * | 2020-05-20 | 2023-03-07 | Fend Incorporated | One-way transfer device with secure reverse channel |
US20210367972A1 (en) * | 2020-05-20 | 2021-11-25 | Fend Incorporated | One-way transfer device with secure reverse channel |
US11153345B1 (en) * | 2020-05-20 | 2021-10-19 | Fend Incorporated | One-way transfer device with secure reverse channel |
US11709970B1 (en) | 2022-12-19 | 2023-07-25 | Fend Incorporated | One-way communication data diode on a chip |
US11954235B1 (en) | 2022-12-19 | 2024-04-09 | Fend Incorporated | One-way communication data diode on a chip |
Also Published As
Publication number | Publication date |
---|---|
EP2838031A2 (en) | 2015-02-18 |
EP2838031B1 (en) | 2017-06-28 |
TW201516687A (en) | 2015-05-01 |
US8943234B1 (en) | 2015-01-27 |
KR101575502B1 (en) | 2015-12-07 |
TWI534626B (en) | 2016-05-21 |
EP2838031A3 (en) | 2015-04-22 |
KR20150016889A (en) | 2015-02-13 |
JP2015032304A (en) | 2015-02-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8943234B1 (en) | Multi-protocol storage controller | |
KR102419351B1 (en) | A management controller and an operating method of chassis comprising the management controller | |
US9817468B2 (en) | System and method for automatic detection and switching between USB host and device rolls on a type-A connector | |
US20060230211A1 (en) | Method and system for receiver detection in PCI-Express devices | |
US8793425B2 (en) | USB device and detection method thereof | |
JP2013168122A (en) | Usb 3.0 device and control method | |
US8533300B2 (en) | Storage device, controller, and address management method | |
KR20190073055A (en) | Storage controller, storage device including the same, and operation method of storage controller | |
JP2019134419A (en) | Uart communication-speed automatic-switching method | |
US9081910B2 (en) | Methods and structure for fast context switching among a plurality of expanders in a serial attached SCSI domain | |
US9304960B2 (en) | Delayed physical link activation in serial attached small computer system interface devices that utilize smart cabling | |
TW201209589A (en) | Methods and apparatus for improved serial advanced technology attachment performance | |
WO2012047719A4 (en) | Remote access appliance with communication protocol autosensing feature | |
WO2018116314A1 (en) | A method and a mirrored serial interface (msi) for transferring data | |
US20160132448A1 (en) | Hub module with a single bridge shared among multiple connection ports to support role reversal | |
TW201734787A (en) | Electronic apparatus and detection method using the same | |
TW201743218A (en) | Solid state drive control device and method | |
CN105302746A (en) | Multiprotocol storage controller | |
JP2010212989A (en) | Address decoder and address setting method | |
US7171525B1 (en) | Method and system for arbitrating priority bids sent over serial links to a multi-port storage device | |
US9952993B2 (en) | Single-wire communication with adaptive start-bit condition | |
TWI630485B (en) | Extensible host controller and operation method thereof | |
US20200150901A1 (en) | Electronic device for communicating with host and operating method of the electronic device | |
US9542348B2 (en) | Arbitration monitoring for serial attached small computer system interface systems during discovery | |
US9137005B2 (en) | Managing arbitration in mixed link rate wide ports |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: LSI CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:VOORHEES, WILLIAM W.;PETTY, WILLIAM K.;SAGHI, EUGENE;SIGNING DATES FROM 20130808 TO 20130809;REEL/FRAME:030990/0737 |
|
AS | Assignment |
Owner name: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AG Free format text: PATENT SECURITY AGREEMENT;ASSIGNORS:LSI CORPORATION;AGERE SYSTEMS LLC;REEL/FRAME:032856/0031 Effective date: 20140506 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LSI CORPORATION;REEL/FRAME:035390/0388 Effective date: 20140814 |
|
AS | Assignment |
Owner name: LSI CORPORATION, CALIFORNIA Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (RELEASES RF 032856-0031);ASSIGNOR:DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT;REEL/FRAME:037684/0039 Effective date: 20160201 Owner name: AGERE SYSTEMS LLC, PENNSYLVANIA Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (RELEASES RF 032856-0031);ASSIGNOR:DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT;REEL/FRAME:037684/0039 Effective date: 20160201 |
|
AS | Assignment |
Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH CAROLINA Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:037808/0001 Effective date: 20160201 Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:037808/0001 Effective date: 20160201 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD., SINGAPORE Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:041710/0001 Effective date: 20170119 Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:041710/0001 Effective date: 20170119 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551) Year of fee payment: 4 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITE Free format text: MERGER;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:047422/0464 Effective date: 20180509 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITE Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTION DATE PREVIOUSLY RECORDED AT REEL: 047422 FRAME: 0464. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:048883/0702 Effective date: 20180905 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |