WO2024177697A1 - Hybrid search to train memory and high-speed input/output interfaces - Google Patents
Hybrid search to train memory and high-speed input/output interfaces Download PDFInfo
- Publication number
- WO2024177697A1 WO2024177697A1 PCT/US2023/078493 US2023078493W WO2024177697A1 WO 2024177697 A1 WO2024177697 A1 WO 2024177697A1 US 2023078493 W US2023078493 W US 2023078493W WO 2024177697 A1 WO2024177697 A1 WO 2024177697A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- memory
- search
- dfe
- memory device
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0658—Controller construction arrangements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/01—Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03K—PULSE TECHNIQUE
- H03K19/00—Logic circuits, i.e. having at least two inputs acting on one output; Inverting circuits
- H03K19/0005—Modifications of input or output impedance
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/10—Providing a specific technical effect
- G06F2212/1016—Performance improvement
Definitions
- a data eye refers to the average time between a rising edge of a data signal and a subsequent falling edge.
- Memory subsystems continue to be designed for increasingly higher frequencies for data access, and more specifically, for the transfer of data between the memory device and an associated memory controller.
- Higher data rates mean the frequency between rising and falling edges increases, and shifting phases due to noise results in enough variation of the timing of rising and falling edges that on the average there is no opening between rising and falling edges of the data signal (that is, the data eye is closed).
- FIG.1 is a block diagram of an embodiment of a memory subsystem in a system
- FIG.2 is a block diagram of an embodiment of a memory device
- FIG.3 is a block diagram of an embodiment of a memory device with decision feedback equalization (DFE);
- FIG.4 is a flowgraph illustrating a method performed during training to determine the values of the DFE coefficients for the taps in the filter shown in FIG.3
- FIG.5 is a graph illustrating the relationship between Figure of Merit (FOM) (y-axis) and tap settings (x-axis) used to perform the modified binary search to select a start value for the tap setting for the Tabu search
- FIG.6 is a flow graph of the modified binary
- Equalization can be used to help improve (or open up) the data eye at the DQ input after the data is latched by a receiver in the memory device.
- One approach to recovering the data signal with a collapsed data eye is to implement filtering at the receiver, such as decision feedback equalization (DFE) (where DFE can alternatively refer to a decision feedback equalizer that implements the decision feedback equalization). DFE can improve signaling even at higher data rates.
- DFE can improve signaling even at higher data rates.
- a n-tap decision feedback equalization (DFE) can be used to help equalize the DQ signals without amplifying the noise due to insertion loss and reflections.
- DFE Decision feedback equalization
- a first search is performed to identify initial values of tap coefficients
- a second search uses the initial values of tap coefficients to find the final values of tap coefficients.
- FIG.1 is a block diagram of an embodiment of a memory subsystem in a system 100.
- System 100 includes a processor 110 and elements of a memory subsystem in a computing device.
- Processor 110 represents a processing unit of a computing platform that may execute an operating system (OS) and applications, which can collectively be referred to as the host or the user of the memory.
- OS operating system
- Processor 110 can include one or more separate processors.
- Each separate processor can include a single processing unit, a multicore processing unit, or a combination.
- the processing unit can be a primary processor such as a CPU (central processing unit), a peripheral processor such as a GPU (graphics processing unit), or a combination.
- Memory accesses may also be initiated by devices such as a network controller or hard disk controller. Such devices can be integrated with the processor in some systems or attached to the processer via a bus (e.g., PCI express), or a combination.
- System 100 can be implemented as an SOC (system on a chip), or be implemented with standalone components. [0022] Reference to memory devices can apply to different memory types. Memory devices often refers to volatile memory technologies.
- Volatile memory is memory whose state (and therefore the data stored on it) is indeterminate if power is interrupted to the device. Dynamic volatile memory requires refreshing the data stored in the device to maintain state.
- DRAM Dynamic Random Access Memory
- SDRAM Synchronous DRAM
- a memory subsystem as described herein may be compatible with a number of memory technologies, such as DDR3 (Double Data Rate version 3, original release by JEDEC (Joint Electronic Device Engineering Council) on June 27, 2007).
- DDR4 (DDR version 4, originally published in September 2012 by JEDEC), DDR5 (DDR version 5, originally published in July 2020), LPDDR3 (Low Power DDR version 3, JESD209- 3B, August 2013 by JEDEC), LPDDR4 (LPDDR version 4, JESD209-4, originally published by JEDEC in August 2014), LPDDR5 (LPDDR version 5, JESD209-5A, originally published by JEDEC in January 2020), WIO2 (Wide Input/Output version 2, JESD229-2 originally published by JEDEC in August 2014), HBM (High Bandwidth Memory, JESD235, originally published by JEDEC in October 2013), HBM2 (HBM version 2, JESD235C, originally published by JEDEC in January 2020), or HBM3 (HBM version 3 currently in discussion by JEDEC), or others or combinations of memory technologies, and technologies based on derivatives or extensions of such specifications.
- LPDDR3 Low Power DDR version 3, JESD209- 3B, August 2013 by
- Memory controller 120 represents one or more memory controller circuits or devices for system 100. Memory controller 120 represents control logic that generates memory access commands in response to the execution of operations by processor 110.
- Memory controller 120 accesses one or more memory devices 140.
- Memory devices 140 can be DRAM devices in accordance with any referred to above.
- memory devices 140 are organized and managed as different channels, where each channel couples to buses and signal lines that couple to multiple memory devices in parallel. Each channel is independently operable. Thus, each channel is independently accessed and controlled, and the timing, data transfer, command and address exchanges, and other operations are separate for each channel.
- coupling can refer to an electrical coupling, communicative coupling, physical coupling, or a combination of these. Physical coupling can include direct contact.
- Electrical coupling includes an interface or interconnection that allows electrical flow between components, or allows signaling between components, or both.
- Communicative coupling includes connections, including wired or wireless, that enable components to exchange data.
- each memory controller 120 manages a separate memory channel, although system 100 can be configured to have multiple channels managed by a single controller, or to have multiple controllers on a single channel. In one embodiment, memory controller 120 is part of host processor 110, such as logic implemented on the same die or implemented in the same package space as the processor. [0026] Memory controller 120 includes I/O (Input/Output) interface logic 122 to couple to a memory bus, such as a memory channel as referred to above.
- I/O Input/Output
- I/O interface logic 122 (as well as I/O interface logic 142 of memory device 140) can include pins, pads, connectors, signal lines, traces, or wires, or other hardware to connect the devices, or a combination of these.
- I/O interface logic 122 can include a hardware interface. As illustrated, I/O interface logic 122 includes at least drivers/transceivers for signal lines. Commonly, wires within an integrated circuit interface couple with a pad, pin, or connector to interface signal lines or traces or other wires between devices. I/O interface logic 122 can include drivers, receivers, transceivers, or termination, or other circuitry or combinations of circuitry to exchange signals on the signal lines between the devices.
- I/O interface logic 122 can also be referred to as Double Data Rate IO (DDRIO) logic.
- the memory controller 120 includes a Memory Training Engine (MTE) to train the I/O interface logic 122.
- MTE Memory Training Engine
- the exchange of signals includes at least one of transmit or receive. While shown as coupling I/O interface logic122 from memory controller 120 to I/O interface logic 142 of memory device 140, it will be understood that in an implementation of system 100 where groups of memory devices 140 are accessed in parallel, multiple memory devices can include I/O interfaces to the same interface of memory controller 120.
- I/O interface logic 142 can include interface hardware of the memory module in addition to interface hardware on the memory device itself.
- Other memory controllers 120 can include separate interfaces to other memory devices 140.
- the bus between memory controller 120 and memory devices 140 can be implemented as multiple signal lines coupling the memory controller 120 to memory devices 140.
- the bus may typically include at least clock (CLK) 132, command/address (CMD) 134, and write and read data (DQ) 136, and zero or more other signal lines 138.
- CLK clock
- CMD command/address
- DQ write and read data
- a bus or connection between memory controller 120 and memory can be referred to as a memory bus.
- the signal lines for CMD can be referred to as a "C/A bus" (or ADD/CMD bus, or some other designation indicating the transfer of commands (C or CMD) and address (A or ADD) information) and the signal lines for write and read data DQ can be referred to as a "data bus.”
- independent channels have different clock signals, C/A buses, data buses, and other signal lines.
- system 100 can be considered to have multiple "buses,” in the sense that an independent interface path can be considered a separate bus.
- a bus can include at least one of strobe signaling lines, alert lines, auxiliary lines, or other signal lines, or a combination.
- serial bus technologies can be used for the connection between memory controller 120 and memory devices 140.
- An example of a serial bus technology is 8B10B encoding and transmission of high-speed data with embedded clock over a single differential pair of signals in each direction.
- CMD 134 represents signal lines shared in parallel with multiple memory devices.
- multiple memory devices share encoding command signal lines of CMD 134, and each has a separate chip select (CS_n) signal line to select individual memory devices.
- CS_n chip select
- the bus between memory controller 120 and memory devices 140 includes a subsidiary command bus CMD 134 and a subsidiary bus to carry the write and read data, DQ 136.
- the data bus can include bidirectional lines for read data and for write/command data.
- the subsidiary bus DQ 136 can include unidirectional write signal lines for write and data from the host to memory, and can include unidirectional lines for read data from the memory to the host.
- other signal lines 138 may accompany a bus or sub bus, such as strobe lines DQS.
- the data bus can have more or less bandwidth per memory device 140.
- the data bus can support memory devices that have either a x32 interface, a x16 interface, a x8 interface, or other interface.
- xW The convention "xW,” where W is an integer that refers to an interface size or width of the interface of memory device 140, which represents a number of signal lines to exchange data with memory controller 120.
- the interface size of the memory devices is a controlling factor on how many memory devices can be used concurrently per channel in system 100 or coupled in parallel to the same signal lines.
- high bandwidth memory devices, wide interface devices, or stacked memory configurations, or combinations can enable wider interfaces, such as a x128 interface, a x256 interface, a x512 interface, a x1024 interface, or other data bus interface width.
- memory devices 140 and memory controller 120 exchange data over the data bus in a burst, or a sequence of consecutive data transfers.
- the burst corresponds to a number of transfer cycles, which is related to a bus frequency.
- the transfer cycle can be a whole clock cycle for transfers occurring on a same clock or strobe signal edge (e.g., on the rising edge).
- every clock cycle referring to a cycle of the system clock, is separated into multiple unit intervals (UIs), where each UI is a transfer cycle.
- UIs unit intervals
- double data rate transfers trigger on both edges of the clock signal (e.g., rising and falling).
- a burst can last for a configured number of UIs, which can be a configuration stored in a register, or triggered on the fly.
- Memory devices 140 represent memory resources for system 100.
- each memory device 140 is a separate memory die.
- each memory device 140 can interface with multiple (e.g., 2) channels per device or die.
- Each memory device 140 includes I/O interface logic 142, which has a bandwidth determined by the implementation of the device (e.g., x16 or x8 or some other interface bandwidth).
- I/O interface logic 142 enables the memory devices to interface with memory controller 120.
- I/O interface logic 142 can include a hardware interface, and can be in accordance with I/O interface logic 122 of memory controller, but at the memory device end.
- multiple memory devices 140 are connected in parallel to the same command and data buses.
- multiple memory devices 140 are connected in parallel to the same command bus, and are connected to different data buses.
- system 100 can be configured with multiple memory devices 140 coupled in parallel, with each memory device responding to a command, and accessing memory resources 160 internal to each. For a Write operation, an individual memory device 140 can write a portion of the overall data word, and for a Read operation, an individual memory device 140 can fetch a portion of the overall data word.
- a specific memory device can provide or receive, respectively, 8 bits of a 128- bit data word for a Read or Write transaction, or 8 bits or 16 bits (depending for a x8 or a x16 device) of a 256-bit data word. The remaining bits of the word will be provided or received by other memory devices in parallel.
- memory devices 140 are disposed directly on a motherboard or host system platform (e.g., a PCB (printed circuit board) on which processor 110 is disposed) of a computing device.
- memory devices 140 can be organized into memory modules 170.
- memory modules 170 represent dual inline memory modules (DIMMs).
- memory modules 170 represent other organization of multiple memory devices to share at least a portion of access or control circuitry, which can be a separate circuit, a separate device, or a separate board from the host system platform.
- Memory modules 170 can include multiple memory devices 140, and the memory modules can include support for multiple separate channels to the included memory devices disposed on them.
- memory devices 140 may be incorporated into the same package as memory controller 120, such as by techniques such as multi-chip-module (MCM), package-on-package, through-silicon via (TSV), or other techniques or combinations.
- MCM multi-chip-module
- TSV through-silicon via
- multiple memory devices 140 may be incorporated into memory modules 170, which themselves may be incorporated into the same package as memory controller 120.
- Memory devices 140 each include memory resources 160.
- Memory resources 160 represent individual arrays of memory locations or storage locations for data. Typically, memory resources 160 are managed as rows of data, accessed via word line (rows) and bit line (individual bits within a row) control.
- Memory resources 160 can be organized as separate channels, ranks, and banks of memory. Channels may refer to independent control paths to storage locations within memory devices 140. Ranks may refer to common locations across multiple memory devices (e.g., same row addresses within different devices). Banks may refer to arrays of memory locations within a memory device 140.
- banks of memory are divided into sub-banks with at least a portion of shared circuitry (e.g., drivers, signal lines, control logic) for the sub-banks.
- shared circuitry e.g., drivers, signal lines, control logic
- channels, ranks, banks, sub-banks, bank groups, or other organizations of the memory locations, and combinations of the organizations can overlap in their application to physical resources.
- the same physical memory locations can be accessed over a specific channel as a specific bank, which can also belong to a rank.
- the organization of memory resources will be understood in an inclusive, rather than exclusive, manner.
- memory devices 140 include one or more registers 144.
- Register 144 represents one or more storage devices or storage locations that provide configuration or settings for the operation of the memory device.
- register 144 can provide a storage location for memory device 140 to store data for access by memory controller 120 as part of a control or management operation.
- register 144 includes one or more Mode Registers.
- register 144 includes one or more multipurpose registers. The configuration of locations within register 144 can configure memory device 140 to operate in a different "mode," where command information can trigger different operations within memory device 140 based on the mode. Additionally, or in the alternative, different modes can also trigger different operation from address information or other signal lines depending on the mode.
- Settings of register 144 can indicate configuration for I/O settings (e.g., timing, termination or ODT (on-die termination) 146, driver configuration, or other I/O settings).
- memory device 140 includes ODT 146 as part of the interface hardware associated with I/O interface logic 142.
- ODT 146 can be configured as mentioned above, and provide settings for impedance to be applied to the interface to specified signal lines. In one embodiment, ODT 146 is applied to DQ signal lines. In one embodiment, ODT 146 is applied to command signal lines. In one embodiment, ODT 146 is applied to address signal lines. In one embodiment, ODT 146 can be applied to any combination of the preceding.
- the ODT settings can be changed based on whether a memory device is a selected target of an access operation or a non-target device. ODT 146 settings can affect the timing and reflections of signaling on the terminated lines.
- Memory device 140 includes controller 150, which represents control logic within the memory device to control internal operations within the memory device. For example, controller 150 decodes commands sent by memory controller 120 and generates internal operations to execute or satisfy the commands. Controller 150 can be referred to as an internal controller, and is separate from memory controller 120 of the host. Controller 150 can determine what mode is selected based on register 144, and configure the internal execution of operations for access to memory resources 160 or other operations based on the selected mode.
- Controller 150 generates control signals to control the routing of bits within memory device 140 to provide a proper interface for the selected mode and direct a command to the proper memory locations or addresses.
- Controller 150 includes command logic 152, which can decode command encoding received on command and address signal lines.
- command logic 152 can be or include a command decoder.
- memory device can identify commands and generate internal operations to execute requested commands.
- scheduler 130 represents logic or circuitry to generate and order transactions to send to memory device 140. From one perspective, the primary function of memory controller 120 can be considered to schedule memory access and other transactions to memory device 140.
- Such scheduling can include generating the transactions themselves to implement the requests for data by processor 110 and to maintain integrity of the data (e.g., such as with commands related to refresh).
- Transactions can include one or more commands, and result in the transfer of commands or data or both over one or multiple timing cycles such as clock cycles or unit intervals.
- Transactions can be for access such as read or write or related commands or a combination, and other transactions can include memory management commands for configuration, settings, data integrity, or other commands, or a combination.
- Memory controller 120 typically includes logic to allow selection and ordering of transactions to improve performance of system 100. Thus, memory controller 120 can select which of the outstanding transactions should be sent to memory device 140 in which order, which is typically achieved with logic much more complex that a simple first-in first-out algorithm.
- Memory controller 120 manages the transmission of the transactions to memory device 140, and manages the timing associated with the transaction. In one embodiment, transactions have deterministic timing, which can be managed by memory controller 120 and used in determining how to schedule the transactions.
- memory controller 120 includes command (CMD) logic 124, which represents logic or circuitry to generate commands to send to memory devices 140. The generation of the commands can refer to the command prior to scheduling, or the preparation of queued commands ready to be sent.
- the signaling in memory subsystems includes address information within or accompanying the command to indicate or select one or more memory locations where the memory devices should execute the command.
- FIG.2 is a block diagram of an embodiment of a memory device 200.
- Memory device 200 represents one example of a memory device in accordance with memory devices 140 of system 100.
- memory device 200 is a DRAM device mounted to a substrate to connect to a CPU as in-package memory.
- Address (addr) register 220 receives address information (ADDR) such as row address and bank address signals to identify the portion of memory that is to be affected by a particular command.
- the address, clock (CLK), clock enable (CKE), and command (CMD) and control (CTRL) signals represent I/O connectors for command and address for memory device 200.
- Control logic 210 receives CLK, CKE, and CMD, and controls the operation of memory device 200 in relation to those signals.
- address register 220 distributes the address information to row address multiplexer (row addr mux) 222, bank control (ctrl) logic 224, and column address counter (col addr cntr) 226.
- Row address mux 222 takes the row address information and a refresh counter (ref 228) as input, and controls the row address latch (RAL) and decoder (row decoder 232) for each bank of the memory device.
- Bank control logic 224 selects the bank that is selected for the memory access operation (e.g., based on the command) received.
- Column address counter 226 generates a signal to select the column for the operation.
- Row decoder (dec) 232 selects an address in a bank, which can include a row of memory array 230.
- memory array 230 can be or include subarrays.
- Signals from bank control logic 224 and column address counter 226 can trigger column decoder (col dec) 234 to activate the appropriate sense amplifiers (SA) 242 for the desired memory array 230.
- Column decoder (col dec) 234 can trigger I/O gating 240, which represent the hardware including signal lines or wires as well as logic to route data to and from memory arrays 230.
- I/O gating 240 can place data into sense amplifiers 242 for a write operation, and can read the data out for a read operation.
- Column decoder 234 makes a column selection for I/O gating 240 based on bank control logic selection and the column address counter selection.
- read latch 250 is coupled to receive data bits from I/O gating 240 for a read operation. Read latch 250 feeds the data into mux 252, which can select the number of bits corresponding to the device data interface. Mux 252 can send the data to driver (drvr) 254, which will drive the data on I/O connectors DQ[0:(N-1)]. While not specifically illustrated, it will be understood that driver 254 can drive on or more data strobe lines based on the timing. [0043] For a write operation, the controller provides data on DQ[0:(N-1)].
- receiver (rcvr) 260 receives write data from the data bus, and inputs it into input register or input buffer 262.
- Input buffer (buf) 262 samples the data in accordance with a data strobe line, and can latch the data to write driver (drvr) 264, which provides the data to I/O gating 240.
- Memory device 200 includes mode registers (regs) 212 that store configuration information to control various operational modes for memory device 200. Control logic 210 can operate based on settings stored in mode registers 212.
- Memory device 200 includes DFE 266 to provide filtering for receive data. The filtering can operate to "open" the data eye for data signals received by receiver 260.
- FIG.3 is a block diagram of an embodiment of a memory device with decision feedback equalization.
- System 300 can be one example of a memory device in accordance with any embodiment described herein, such as memory device 140 of Figure 1 or memory device 200 of Figure 2.
- System 300 illustrates components of receive I/O for the memory device. More specifically, system 300 illustrates N data signal line interfaces, DQ[N-1:0].
- system 300 includes DFE between the data signal line interface and receiver circuitry 340.
- each signal line has separate DFE circuitry, as illustrated by DFE 310 on the input path of DQ[0], DFE 320 on the input path of DQ[1], and DFE 330 on the input path of DQ[N-1]. Only the details of DFE 310 are illustrated, but the other DFE components can be similar or the same.
- the DFE circuitry provides filtered data to receiver circuitry 340 for further processing by the memory device, and to perform operations on the memory array based on the received commands.
- the memory device of system 300 can include mode registers (MR) 350.
- MR mode registers
- DFE 310 includes summation circuit 312 at its front end, decision slicer circuit 314 at its back end, and filter 316.
- Filter 316 can be referred to as a feedback path or a tapped feedback path that includes multiple taps for multiple previously sampled digital bit values.
- DFE 310 can remove inter symbol interference (ISI) to reduce distortion for a received high speed digital signal stream on DQ[0].
- ISI inter symbol interference
- Very high speed digital pulses tend to lose their sharp rectangular shape as they propagate along a signal trace, resulting in more drawn out, wider, rounder shapes by the time they are received at the receiving end. The wider rounded pulses can extend into the time slot of neighboring pulses. The pulse shape of any pulse can therefore become even more corrupted by the interfering waveforms of its neighboring pulses in the digital stream.
- filter 316 includes M "taps" T[M:1] in a feedback loop, where the different taps can be specifically tuned to remove interference from a preceding pulse or a pulse that was received ahead of the current pulse whose digital value is being determined.
- Decision slicer circuit 314 determines the digital value (1 or 0) of the digital pulse that is currently being received.
- the M taps have associated coefficients Wn to configure the tap for removing interference from a preceding digital pulse.
- the coefficients are determined for each tap and stored in corresponding mode registers 318.
- the coefficients can capture the amplitude (or amount) of a prior pulse that interferes with the current pulse, and summation circuit 312 subtracts the particular amplitude from the currently received signal.
- the taps are designed for specific previously received signals.
- tap T[1] can be configured to remove interference from an immediately preceding received signal, T[2] from the received signal prior to that, and so forth.
- the DFE can be configured to remove interference from as many preceding signals as determined for a system, with one tap per preceding signal.
- DFE 310 includes two taps.
- DFE 310 includes four taps.
- DFE 310 includes six taps. Other numbers of taps are possible. [0051] It will be understood that with different signal paths for the different data bits, the DFE coefficients can be different for each tap, and for each DFE circuit.
- the group of mode register 318 stores configuration information for DFE 310, and more specifically for the different taps of filter 316.
- mode registers 328 provide configuration for taps of a filter path for DFE 320.
- mode registers 338 provide configuration for taps of a filter path for DFE 330.
- System 300 determines the values of the various coefficients during training, such as in conjunction with boot up. The host associated with system 300 (not specifically shown) can determine the coefficients and write them to the various mode registers.
- FIG.4 is a flowgraph illustrating a method performed during read DFE training to determine the values of the DFE coefficients for the taps. Read DFE training is used to tune the Host side Receiver DFE.
- the Read DFE Training is performed during initialization of the memory module and during operation of the memory module upon changes to interacting parameters such as, changes to continuous time linear equalization (CTLE), On Die Termination (ODT) changes, or any other parameters that may change the swing of the signal, the common mode of the signal, or the channel behavior.
- CTLE continuous time linear equalization
- ODT On Die Termination
- the DRAM Read Training Pattern is configured in the mode registers in the memory controller and the Memory Training Engine (MTE) Pattern in the MTE 126 is configured to match the DRAM Read Training Pattern.
- MTE Memory Training Engine
- a Tabu table is created in the memory controller 120 to store all tested data Tap combinations and the Per-DQ FOM for the tested data taps including the tested data taps collected during the modified binary search.
- the per DQ predicted starting point is found for each tap using the modified binary search.
- the per DQ dfe_coeff setting for the current Tap is set to the PredictedStartPoint before moving to the next tap.
- BestCurrentTapSolution [32, 16, 0, 0, 0, 0] after Tap1 sweep the best setting is 32, after Tap2 sweep the best setting is 16.
- the Tabu search is performed with BestCurrentTapSolution and TabuList as the starting point.
- the per DQ Best Tap Solution is found for all Tap Coefficients using the Tabu Sweep Method.
- DFE Gain can be added as a variable in the solution space for determining neighbors.
- FIG.5 is a graph illustrating the relationship between Figure of Merit (FOM) (y-axis) and tap settings (x-axis) used to perform the modified binary search to select a start value for the tap setting for the Tabu search.
- FOM Figure of Merit
- x is the tap setting for the test point
- y is the FOM measured at x.
- a figure of merit (FOM) is a quantity used to characterize the performance of a device, system or method, relative to its alternatives.
- Rx margins can include RxVref Eye Height (RxVref Top Edge – RxVref Bottom Edge), RxDQS Eye width (RxDqs Right Edge – RxDqs Left Edge), area of the eye passing region (sum of all the RxVref Eye Heights at each RxDQS Offset), Max Rx Vref (max RxVref Eye Height at any RxDQS Offset).
- Each FOM data point is associated with (that is, the tap setting combination is set and a measurement or series of measurements is made to determine the Figure of Merit) a combination of settings for the Rx DFE Tap Coefficients.
- the set of FOM data points collected across both the modified binary search and the Tabu search method is used to determine the final tap coefficient combination.
- the modified binary search is performed using tap-coefficients (for example, Tap1,...Tap6) to select the next tap setting to be the middle of the biggest gap of untested tap settings.
- FOM is measured at tap settings for test points (x1, y1), (x2, y2), (x3, y3).
- x is the tap setting for the test point and y is the FOM measured at x.
- the search through the tap-coefficients to select a start value for the tap setting for the Tabu search is performed until the Gap Stop Condition is met or the High in the Middle, and Low on the Sides (HMLS) condition is met.
- FIG.6 is a graph illustrating a numerical example of the relationship between Figure of Merit (FOM) (y-axis) and tap settings (x-axis) used to perform the modified binary search to select a start value for the tap setting for the Tabu search.
- the graph includes test points (20, 59), (32,73), (42, 81), (46, 78), (52, 82) and (56, 81) for a tap coefficient with a value between 0 and 64.
- FIG.7 is a flow graph of the modified binary search to select a start value for the tap setting for the Tabu search.
- FIG.7 will be described in conjunction with the numerical examples shown in FIG.6 for a tap coefficient with a value between 0 and 64.
- the tap setting and FOM for test point (x2, y2) is initialized to (0,0)
- the tap setting x1 for test point (x1, y2) is set to 20 (the maximum tap coefficient (64) divided by 3)
- the tap setting for test point (x3, y3) is set to 42 ((the maximum tap coefficient (64) multiplied by 2) divided by 3).
- some of the computed numerical values of the test points are incremented/decremented to an even number to simplify the computation for the numerical example.
- test point (x2, y2) is (0, 0) (the minimum tap setting and minimum FOM)
- x1 is 20 (64 (the maximum tap setting) divided by 3)
- x3 is 42 ((64 (the maximum tap setting) multiplied by 2) divided by 3).
- the FOM at tap setting x1 and tap setting x3 is measured, y1 is 59 and y3 is 81.
- the values of the three test points (x1, y1), (x2, y2), (x3, y3) are (20, 59), (0, 0) and (42, 81).
- y1 is 59
- y2 is 0
- y3 is 81.
- new test points (x1,y1), (x2,y2) and (x3,y3) are selected for the second iteration using the test points for the first iteration.
- Test points (x3, y3) (42,81) used for the first iteration are selected as test points (x2, y2) (42,81) for the second iteration.
- Tap setting x1(20) used in the first iteration is selected as the minimum tap setting for the second iteration.
- test point (x2, y2) is (42, 81), x1 is 32 (x2(42) – ((x2 (42)- minimum tap setting (20)) divided by 2)), and x3 is 52 (x2(42) + ((max tap setting (64)- x2(42) divided by 2).
- the FOM at tap setting x1 and tap setting x3 is measured, y1 is 73 and y3 is 82.
- the values of the three test points (x1, y1), (x2, y2), (x3, y3) are (32, 73), (42, 81) and (52, 82). Processing continues with block 708.
- test point (x2, y2) is (52, 82), x1 is 46 (x2(52) – ((x2 (52)- minimum tap setting (42)) divided by 2)), and x3 is 58 (x2(52) + ((max tap setting (64)- x2(52) divided by 2).
- the FOM at tap setting x1 and tap setting x3 is measured, y1 is 78 and y3 is 81.
- the values of the three test points (x1, y1), (x2, y2), (x3, y3) are (46, 78), (52, 82) and (58, 81).
- y1 is 73
- y2 is 82
- y3 is 81. All FOMs (y1, y2, y3) are non-zero, processing continues with block 704.
- processing continues with block 710.
- the HMLS condition is reached.
- FIG.8 is a flow graph of the Tabu search to select a final value for the tap setting.
- Tabu is an optimized search method that combines a neighborhood search with a tabu list.
- the neighborhood search is the process of choosing the next test points as the immediate neighbors to a current best solution space.
- the tap settings in the TabuList are not used by the Tabu search so that the Tabu search is not performed in suboptimal regions.
- a TabuSearchCount that is initialized to 0 keeps track of the number of neighborhood iterations that have been performed.
- the NeighborhoodDistance (the search distance from the current tap settings) is +/- 1.
- a numerical example for a neighborhood (for example, the first three rows in the neighbors array) with Tap1 (third row) set to 50 is shown below: [51, 39, 28, 15, 15, 8] [49, 39, 28, 15, 15, 8] [50, 40, 28, 15, 15, 8] [0091] If the FOM is greater than the BestCurrentFOM, the FOM is stored as the BestCurrentFOM and the BestCurrentTapSolution is neighbor. [0092] At block 806, if no neighbors are found where the FOM is greater than the BestCurrentFOM, then move to max FOM neighbor from the current neighbors list.
- FIG.9 is a block diagram of an embodiment of a computer system 900 that includes the memory module 170 that includes the memory device 200.
- Computer system 900 can correspond to a computing device including, but not limited to, a server, a workstation computer, a desktop computer, a laptop computer, and/or a tablet computer.
- the computer system 900 includes a system on chip (SOC or SoC) 904 which combines processor, graphics, memory, and Input/Output (I/O) control logic into one SoC package.
- the SoC 904 includes at least one Central Processing Unit (CPU) module 908, a memory controller 120, and a Graphics Processor Unit (GPU) 910.
- the memory controller 120 can be external to the SoC 904.
- the CPU module 908 includes at least one processor core 902, and a level 2 (L2) cache 906.
- each of the processor core(s) 902 can internally include one or more instruction/data caches, execution units, prefetch buffers, instruction queues, branch address calculation units, instruction decoders, floating point units, retirement units, etc.
- the CPU module 908 can correspond to a single core or a multi-core general purpose processor, such as those provided by Intel® Corporation, according to one embodiment.
- the Graphics Processor Unit (GPU) 910 can include one or more GPU cores and a GPU cache which can store graphics related data for the GPU core.
- the GPU core can internally include one or more execution units and one or more instruction and data caches.
- the Graphics Processor Unit (GPU) 910 can contain other graphics logic units that are not shown in Fig.9, such as one or more vertex processing units, rasterization units, media processing units, and codecs.
- one or more I/O adapter(s) 916 are present to translate a host communication protocol utilized within the processor core(s) 902 to a protocol compatible with particular I/O devices.
- Some of the protocols that adapters can be utilized for translation include Peripheral Component Interconnect (PCI)-Express (PCIe); Universal Serial Bus (USB); Serial Advanced Technology Attachment (SATA) and Institute of Electrical and Electronics Engineers (IEEE) 1594 “Firewire”.
- the I/O adapter(s) 916 can communicate with external I/O devices 924 which can include, for example, user interface device(s) including a display 944 and/or a touch-screen display, printer, keypad, keyboard, communication logic, wired and/or wireless, storage device(s) including hard disk drives (“HDD”), solid-state drives (“SSD”), removable storage media, Digital Video Disk (DVD) drive, Compact Disk (CD) drive, Redundant Array of Independent Disks (RAID), tape drive or other storage device.
- user interface device(s) including a display 944 and/or a touch-screen display, printer, keypad, keyboard, communication logic, wired and/or wireless
- storage device(s) including hard disk drives (“HDD”), solid-state drives (“SSD”), removable storage media, Digital Video Disk (DVD) drive, Compact Disk (CD) drive, Redundant Array of Independent Disks (RAID), tape drive or other storage device.
- HDD hard disk drives
- SSD solid-state
- the storage devices can be communicatively and/or physically coupled together through one or more buses using one or more of a variety of protocols including, but not limited to, SAS (Serial Attached SCSI (Small Computer System Interface)), PCIe (Peripheral Component Interconnect Express), NVMe (NVM Express) over PCIe (Peripheral Component Interconnect Express), and SATA (Serial ATA (Advanced Technology Attachment)).
- SAS Serial Attached SCSI (Small Computer System Interface)
- PCIe Peripheral Component Interconnect Express
- NVMe NVM Express
- SATA Serial ATA (Advanced Technology Attachment)
- the display 944 to display data stored in the plurality of memory devices 200 in the memory module 170.
- Power source 940 provides power to the components of computer system 900. More specifically, power source 940 typically interfaces to one or multiple power supplies 942 in computer system 900 to provide power to the components of computer system 900.
- power supply 942 includes an AC to DC (alternating current to direct current) adapter to plug into a wall outlet. Such AC power can be renewable energy (e.g., solar power) power source 940.
- power source 940 includes a DC power source, such as an external AC to DC converter.
- power source 940 or power supply 942 includes wireless charging hardware to charge via proximity to a charging field.
- power source 940 can include an internal battery or fuel cell source.
- Flow diagrams as illustrated herein provide examples of sequences of various process actions. The flow diagrams can indicate operations to be executed by a software or firmware routine, as well as physical operations.
- a flow diagram can illustrate the state of a finite state machine (FSM), which can be implemented in hardware and/or software. Although shown in a particular sequence or order, unless otherwise specified, the order of the actions can be modified. Thus, the illustrated embodiments should be understood as an example, and the process can be performed in a different order, and some actions can be performed in parallel.
- FSM finite state machine
- one or more actions can be omitted in various embodiments; thus, not all actions are required in every embodiment. Other process flows are possible. [00106] To the extent various operations or functions are described herein, they can be described or defined as software code, instructions, configuration, and/or data.
- the content can be directly executable ("object” or “executable” form), source code, or difference code (“delta” or "patch” code).
- the software content of the embodiments described herein can be provided via an article of manufacture with the content stored thereon, or via a method of operating a communication interface to send data via the communication interface.
- a machine readable storage medium can cause a machine to perform the functions or operations described, and includes any mechanism that stores information in a form accessible by a machine (e.g., computing device, electronic system, etc.), such as recordable/non-recordable media (e.g., read only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, etc.).
- a communication interface includes any mechanism that interfaces to any of a hardwired, wireless, optical, etc., medium to communicate to another device, such as a memory bus interface, a processor bus interface, an Internet connection, a disk controller, etc.
- the communication interface can be configured by providing configuration parameters and/or sending signals to prepare the communication interface to provide a data signal describing the software content.
- the communication interface can be accessed via one or more commands or signals sent to the communication interface.
- Various components described herein can be a means for performing the operations or functions described. Each component described herein includes software, hardware, or a combination of these. The components can be implemented as software modules, hardware modules, special-purpose hardware (e.g., application specific hardware, application specific integrated circuits (ASICs), digital signal processors (DSPs), etc.), embedded controllers, hardwired circuitry, etc.
- ASICs application specific integrated circuits
- DSPs digital signal processors
- embedded controllers hardwired circuitry, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Computational Linguistics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Dram (AREA)
Abstract
Description
Claims
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020257024372A KR20250153185A (en) | 2023-02-22 | 2023-11-02 | Hybrid search for training memory and high-speed input/output interfaces |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2023077600 | 2023-02-22 | ||
| CNPCT/CN2023/077600 | 2023-02-22 | ||
| US18/120,848 US20230214669A1 (en) | 2023-02-22 | 2023-03-13 | Hybrid search to train memory and high-speed input/output interfaces |
| US18/120,848 | 2023-03-13 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024177697A1 true WO2024177697A1 (en) | 2024-08-29 |
Family
ID=86991801
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2023/078493 Ceased WO2024177697A1 (en) | 2023-02-22 | 2023-11-02 | Hybrid search to train memory and high-speed input/output interfaces |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20230214669A1 (en) |
| KR (1) | KR20250153185A (en) |
| WO (1) | WO2024177697A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20230214669A1 (en) * | 2023-02-22 | 2023-07-06 | Intel Corporation | Hybrid search to train memory and high-speed input/output interfaces |
| US12586632B2 (en) * | 2023-10-04 | 2026-03-24 | Nanya Technology Corporation | Signal receiver, data receiver and data latch thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150131707A1 (en) * | 2013-06-19 | 2015-05-14 | International Business Machines Corporation | Testing a decision feedback equalizer ('dfe') |
| CN108881081A (en) * | 2018-05-31 | 2018-11-23 | 天津芯海创科技有限公司 | Parameter adaptive adjusting method, device and electronic equipment |
| CN114026800A (en) * | 2019-06-21 | 2022-02-08 | Ntt电子股份有限公司 | Adaptive equalizer, adaptive equalization method, and optical communication system |
| US20220148631A1 (en) * | 2020-11-10 | 2022-05-12 | Samsung Electronics Co., Ltd. | Apparatus, memory device, and method for storing multiple parameter codes for operation parameters |
| CN114553189A (en) * | 2022-02-09 | 2022-05-27 | 杭州电子科技大学富阳电子信息研究院有限公司 | Parallel equalization method based on FPGA |
| US20230214669A1 (en) * | 2023-02-22 | 2023-07-06 | Intel Corporation | Hybrid search to train memory and high-speed input/output interfaces |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6307868B1 (en) * | 1995-08-25 | 2001-10-23 | Terayon Communication Systems, Inc. | Apparatus and method for SCDMA digital data transmission using orthogonal codes and a head end modem with no tracking loops |
| US10230552B1 (en) * | 2018-07-26 | 2019-03-12 | Microsemi Storage Solutions, Inc. | System and method for decision feedback equalizer (DFE) adaptation |
-
2023
- 2023-03-13 US US18/120,848 patent/US20230214669A1/en active Pending
- 2023-11-02 WO PCT/US2023/078493 patent/WO2024177697A1/en not_active Ceased
- 2023-11-02 KR KR1020257024372A patent/KR20250153185A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150131707A1 (en) * | 2013-06-19 | 2015-05-14 | International Business Machines Corporation | Testing a decision feedback equalizer ('dfe') |
| CN108881081A (en) * | 2018-05-31 | 2018-11-23 | 天津芯海创科技有限公司 | Parameter adaptive adjusting method, device and electronic equipment |
| CN114026800A (en) * | 2019-06-21 | 2022-02-08 | Ntt电子股份有限公司 | Adaptive equalizer, adaptive equalization method, and optical communication system |
| US20220148631A1 (en) * | 2020-11-10 | 2022-05-12 | Samsung Electronics Co., Ltd. | Apparatus, memory device, and method for storing multiple parameter codes for operation parameters |
| CN114553189A (en) * | 2022-02-09 | 2022-05-27 | 杭州电子科技大学富阳电子信息研究院有限公司 | Parallel equalization method based on FPGA |
| US20230214669A1 (en) * | 2023-02-22 | 2023-07-06 | Intel Corporation | Hybrid search to train memory and high-speed input/output interfaces |
Also Published As
| Publication number | Publication date |
|---|---|
| US20230214669A1 (en) | 2023-07-06 |
| KR20250153185A (en) | 2025-10-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3809412B1 (en) | Reading from a mode register having different read and write timing | |
| US11662926B2 (en) | Input/output (I/O) loopback function for I/O signaling testing | |
| US12443367B2 (en) | Perfect row hammer tracking with multiple count increments | |
| US10339072B2 (en) | Read delivery for memory subsystem with narrow bandwidth repeater channel | |
| US12204751B2 (en) | Reference voltage training per path for high speed memory signaling | |
| US20220300197A1 (en) | Autonomous backside chip select (cs) and command/address (ca) training modes | |
| US11188264B2 (en) | Configurable write command delay in nonvolatile memory | |
| US12470231B2 (en) | Method and apparatus to perform cyclic redundancy check training in a memory module | |
| WO2024177697A1 (en) | Hybrid search to train memory and high-speed input/output interfaces | |
| US20230044892A1 (en) | Multi-channel memory module | |
| NL2031713B1 (en) | Double fetch for long burst length memory data transfer | |
| US20170289850A1 (en) | Write delivery for memory subsystem with narrow bandwidth repeater channel | |
| US10198200B1 (en) | Command sequence response in a memory data buffer | |
| US12524357B2 (en) | Buffer communication for data buffers supporting multiple pseudo channels | |
| US12367943B2 (en) | Reference voltage adjustment per path for high speed memory signaling | |
| US20230385208A1 (en) | Accelerated memory training through in-band configuration register update mode | |
| US11042315B2 (en) | Dynamically programmable memory test traffic router | |
| US12603115B2 (en) | Method and apparatus to perform training on a data bus between a dynamic random access memory (DRAM) and a data buffer on a buffered dual in-line memory module | |
| US20240193109A1 (en) | Apparatus and method to reduce memory power consumption in a memory phy in a memory controller | |
| US20230342035A1 (en) | Method and apparatus to improve bandwidth efficiency in a dynamic random access memory | |
| US12555646B2 (en) | Mode register update (MRUPD) mode | |
| EP4459468A1 (en) | Storage and access of metadata within selective dynamic random access memory (dram) devices | |
| US20230333928A1 (en) | Storage and access of metadata within selective dynamic random access memory (dram) devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23924449 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 1020257024372 Country of ref document: KR Free format text: ST27 STATUS EVENT CODE: A-0-1-A10-A15-NAP-PA0105 (AS PROVIDED BY THE NATIONAL OFFICE) |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWP | Wipo information: published in national office |
Ref document number: 1020257024372 Country of ref document: KR |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 23924449 Country of ref document: EP Kind code of ref document: A1 |



