WO2019027554A1 - Shareable fpga compute engine - Google Patents
Shareable fpga compute engine Download PDFInfo
- Publication number
- WO2019027554A1 WO2019027554A1 PCT/US2018/035377 US2018035377W WO2019027554A1 WO 2019027554 A1 WO2019027554 A1 WO 2019027554A1 US 2018035377 W US2018035377 W US 2018035377W WO 2019027554 A1 WO2019027554 A1 WO 2019027554A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- fpga
- user process
- request
- user
- processing resources
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/76—Architectures of general purpose stored program computers
- G06F15/78—Architectures of general purpose stored program computers comprising a single central processing unit
- G06F15/7867—Architectures of general purpose stored program computers comprising a single central processing unit with reconfigurable architecture
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5022—Mechanisms to release resources
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/52—Program synchronisation; Mutual exclusion, e.g. by means of semaphores
Definitions
- a field-programmable gate array is an integrated circuit device that is programmable by an end user after the FPGA is installed on a circuit board.
- an FPGA includes an array of uncommitted circuit elements, which are called logic blocks. These logic blocks are connected together by interconnect resources making up a programmable interconnect fabric.
- the interconnect resources include logic gates that are inter-wired in multiple, different configurations.
- the logic blocks in the FPGA are configured to perform complex combinational or logic functions.
- the logic blocks in an FPGA also include memory elements, which are implemented as flip-flops or more complete blocks of memory.
- the logic blocks can include elements such as lookup tables (LUTs) and other fixed functions that are programmed by inserting values into small Static Random Access Memories (SRAMs) or registers.
- LUTs lookup tables
- SRAMs Static Random Access Memories
- the programming of the FPGA is performed before the logic blocks can be used. After programming, each combination of function inputs to an LUT results in a predefined output, allowing implementation of any logic function.
- FPGAs are designed to be used as programmable logic engines in the general case, many times the overhead is high. For example, when the FPGA is shared by multiple processors running different computer programs, the repeated programming, inputting data and releasing steps performed for the FPGA consume an appreciable amount of time and resources. Therefore, the use of the FPGA reduces to being used as a fixed-function logic block in the usual deployment. This type of use reduces the flexible capability provided by the FPGA.
- FIG. 1 is a block diagram of one implementation of a system.
- FIG. 2 is a block diagram of one implementation of a cloud computing system.
- FIG. 3 is a block diagram of one implementation of a FPGA card.
- FIG. 4 is a block diagram of a system with a processor coupled to a FPGA.
- FIG. 5 is a block diagram of a system with multiple processors coupled to multiple FPGAs.
- FIG. 6 is a generalized flow diagram illustrating one implementation of a method for sharing an FPGA compute engine.
- FIG. 7 is a generalized flow diagram illustrating another implementation of a method for sharing an FPGA compute engine.
- FIG. 8 is a generalized flow diagram illustrating one implementation of a method for controlling an FPGA compute engine.
- FIG. 9 is a generalized flow diagram illustrating one implementation of a method for utilizing a shared FPGA.
- a system includes one or more processors, one or more memories and one or more field programmable gate arrays (FPGAs).
- the system receives a request to allocate a first FPGA.
- the request is generated by a first user process, and at least a first portion of processing resources of the first FPGA is mapped into an address space of the first user process.
- the first portion of processing resources are programmed by the first user process and input data is provided to the first FPGA.
- the system prevents other user processes different from the first process from accessing the first portion of processing resources of the first FPGA.
- results are conveyed from the first FPGA to the first user process, and the system detects a release of the first portion of the processing resources on the first FPGA by the first user process.
- the system receives a second request from a second user process to allocate the first FPGA.
- the system maps at least a second portion of processing resources of the first FPGA into an address space of the second user process.
- the second portion of processing resources is the same as the first portion of processing resources. In other implementations, the second portion of processing resources is different from the first portion of processing resources.
- the first FPGA is not reduced to being used as a fixed-function logic block, but rather, the first FPGA is used as a programmable logic engine among multiple user processes.
- System 100 includes clients 105A-105N, network 110, and cloud data center 125.
- cloud data center 125 includes any number and type of physical machines, such as computers and/or servers (e.g., database server, file server, application server), and any number and type of storage devices.
- the physical machines of cloud data center 125 include any number and type of processors for executing instructions and/or implementing logic and combinatorial resources. It is noted that in various other implementations, system 100 includes other components and/or the components are arranged differently.
- Cloud data center 125 is representative of any type of computer cluster or collection of multiple physical machines that are connected and work together.
- cloud 125 represents a cloud computing provider with multiple servers.
- cloud 125 represents a high performance computing (UPC) system with multiple compute nodes.
- UPC high performance computing
- cloud 125 represents a front-end/back-end system.
- cloud 125 represents a multi-layer system with multiple physical computers.
- cloud data center 125 is configured to offer cloud computing resources to multiple organizations, companies, or individuals.
- Cloud computing is the delivery of computing as a service where shared resources, software, and information are provided to computers and other devices over a network.
- Cloud computing provides computation, software, data access, and data storage services.
- Many cloud computing infrastructures consist of services delivered through shared data centers and appear as a single point of access.
- cloud data center 125 includes a plurality of servers, including dynamically scalable or virtualized servers.
- network 110 is any type of network or combination of networks, including wireless connection, direct local area network (LAN), metropolitan area network (MAN), wide area network (WAN), a Public Switched Telephone Network (PSTN), an Intranet, the Internet, a cable network, a packet-switched network, a fiber-optic network, a router, storage area network, or other type of network.
- LANs include Ethernet networks, Fiber Distributed Data Interface (FDDI) networks, and token ring networks.
- Network 110 further includes remote direct memory access (RDMA) hardware and/or software, transmission control protocol/internet protocol (TCP/IP) hardware and/or software, router, repeaters, switches, grids, and/or others.
- RDMA remote direct memory access
- TCP/IP transmission control protocol/internet protocol
- router repeaters, switches, grids, and/or others.
- FCoE Fibre Channel over Ethernet
- iSCSI iSCSI
- Clients 105A-105N are representative of any number of devices which are connected to cloud 125 via network 110.
- each of clients 105A-105N corresponds to any of various types of computer systems or computing devices, including, but not limited to, a personal computer system, desktop personal computer (PC), laptop or notebook computer, supercomputer, tablet, phone, smartphone, wearable device, personal digital assistant (PDA), mainframe computer system, handheld computer, workstation, network computer, a consumer device, load balancer, server, file server, application server, storage server, server farm or in general any type of computing system or device.
- clients 105A-105N include one or more processors including one or more processor cores. Each processor core includes circuitry for executing instructions according to an instruction set architecture.
- Cloud computing system 200 includes a plurality of servers 205A-B, which are representative of any number and type of servers.
- server 205A-B includes a plurality of circuit boards, which are also referred to as cards.
- server 205 A includes processor cards 210A-C and FPGA card 210D.
- Server 205 A also includes any number and type of other cards.
- Each card also includes memory and other logic in addition to processors or FPGAs.
- server 205B includes processor cards 220A-C and FPGA card 220D.
- one or more of servers 205A-B includes an FPGA on a motherboard along with a processor in addition to FPGA cards 210D and 220D.
- one or more of servers 205 A-B includes an FPGA with a processor in an integrated processing unit in addition to FPGA cards 210D and 220D.
- a first user process executes an instruction to request FPGA resources from the operating system (OS).
- the OS enables access to the FPGA resources by mapping the FPGA resources into the address space of the first user process in response to receiving the request.
- the first user process programs one or more FPGAs, configures the programmed FPGAs, and then transfers data to be processed by the programmed and configured FPGAs.
- the FPGAs write the processed data to a memory location in the address space of the first user process. Then, the first user process retrieves the data.
- User processes are able to start the FPGA and stop the FPGA by executing a specific instruction, writing to a given register, or by making a request to the OS. User processes are also able to change the clock speed or other performance and power parameters of the FPGA while the FPGA is under control of the user process.
- the first user process After the first user process retrieves the processed data, the first user process returns control of the FPGAs to the OS. Then, in some implementations, other user processes executing on processor cards 210A-C request and utilize the FPGA resources for subsequent computation. Multiple user processes are able to access the same FPGA resources using these techniques. In other implementations, other suitable techniques for sharing FPGA resources among a plurality of user processes are possible and are contemplated.
- FPGA card 300 includes interconnect 310, interconnect logic 315, memory 330, FPGAs 335A-N, peripheral device(s) 340, and JTAG interface 345.
- Interconnect 310 is representative of any type of interconnect for interfacing with processor cards (e.g., processor cards 210A-C of FIG. 2) and/or with other components.
- interconnect 310 is a PCIe interconnect.
- interconnect 310 is a Gen-Z compatible interconnect.
- interconnect 310 is a CCIX compatible interconnect.
- Interconnect logic 315 interfaces between interconnect 310, accelerators 335A-N, and memory 330.
- interconnect logic 315 is implemented using an FPGA, a programmable logic device, or another device.
- interconnect logic 315 includes registers 320 and queue 325.
- interconnect logic 315 includes only registers 320 without queues 325.
- interconnect logic 315 includes only queues 325 without registers 320.
- user processes executing on a processor card interface with one or more FPGAs 335A-N via registers 320 and/or queues 325.
- the instruction when a user process executes an instruction to program a given FPGA 335, the instruction causes a value to be written to first register of registers 320 to initiate the programming process.
- the instruction also writes a value into a second register of registers 320 to indicate where a bitfile 333 is stored, wherein the bitfile is used for programming the given FPGA 335.
- the user process stores bitfile 333 in memory 330, and the user process specifies that bitfile 333 should be used to program the given FPGA 335.
- a library of functions are provided for a user to select from for generating bitfiles to program FPGAs 335.
- different neural network functions, machine learning functions, compression functions, encryption functions, fast fourier transform (FFT) functions, and/or other types of functions are provided in this library.
- the user process selects from and/or combines various functions from the library to generate bitfiles for programming FPGAs 335A-N. The user process then provides their own data to be processed by the programmed FPGAs 335A-N. In some cases, the user combines functions selected from the library with unique logic provided by the user to generate bitfiles. Other variations of techniques for generating bitfiles are possible and are contemplated.
- FPGAs 335A-N are representative of any number and type of programmable devices, accelerator devices, or other types of devices. In one implementation, multiple user processes utilize different partitions of a given FPGA 335. For example, the given FPGA 335 are programmed with a bitfile, and then different user processes access different partitions of the given FPGA 335 for use in processing different datasets.
- FIG. 4 a block diagram of one implementation of a system 400 is shown.
- System 400 includes at least processor 410 and interface 420 coupled to interface 430 and FPGA 440.
- FPGA 440 is representative of any type of programmable device, accelerator, or other similar component. In other implementations, FPGA 440 is one of multiple other types of devices (e.g., application specific integrated circuit (ASIC), graphics processing unit (GPU), digital signal processor (DSP)).
- ASIC application specific integrated circuit
- GPU graphics processing unit
- DSP digital signal processor
- Interfaces 420 and 430 are representative of any type of interface.
- interfaces 420 and 430 are Peripheral Component Interconnect Express (PCIe) interfaces.
- PCIe Peripheral Component Interconnect Express
- system 400 supports resources in FPGA 440 where the hardware functions are altered by the requesting program executing on processor 410.
- System 400 allows for virtualization, partitioning, sequential sharing, and recovery of resources on FPGA 440.
- FPGA 440 presents one physical function to processor 410 for control purposes.
- FPGA 440 presents multiple virtual functions to processor 410 for programming and use.
- System 500 includes processors 505 and 515 coupled to switch/interconnect 525 via interfaces 506 and 516, respectively.
- System 500 also FPGAs 540 and 560 coupled to switch/interconnect 525 via interfaces 530 and 550, respectively.
- FPGAs 540 and 560 are representative of any number and type of programmable devices or accelerator devices.
- each one of FPGAs 540 and 560 is partitioned by the operating system using the physical function.
- Each partition is presented to user processes executing on processors 505 and/or 515 using conventional memory management hardware.
- each partition is shared among multiple processes executing on processors 505 and/or 515 using multiple mappings of memory management hardware.
- User processes executing on processors 505 and/or 515 program FPGAs 540 and 560, feed data to FPGAs 540 and 560, obtain results from FPGAs 540 and 560, and release FPGAs 540 and 560 to be used by another user process.
- system 500 is a distributed computing system (e.g., cluster).
- subscribers to a cloud service are able to access resources in the FPGAs 540 and 560 from programs executing on processors 505 and/or 515.
- FIG. 6 one implementation of a method 600 for sharing a FPGA compute engine is shown.
- steps in this implementation and those of FIG. 7-8 are shown in sequential order.
- one or more of the elements described are performed concurrently, in a different order than shown, or are omitted entirely.
- Other additional elements are also performed as desired. Any of the various systems or apparatuses described herein are configured to implement method 600.
- An operating system receives a request to utilize at least a first portion of processing resources on a first FPGA, wherein the request is generated by a first user process (block 605). It is noted that in other implementations, the system includes any number of FPGAs in addition to the first FPGA. In some cases, the first user process requests the resources of multiple FPGAs. Next, the OS maps the first portion of processing resources of the first FPGA into an address space of the first user process (block 610). Then, the OS prevents other user processes from accessing the first portion of processing resources of the first FPGA (block 615).
- the OS detects a request to release the first portion of the processing resources on the first FPGA by the first user process (block 620).
- the OS receives a request to utilize at least a second portion of the processing resources on the first FPGA, wherein the request is generated by a second user process (block 625).
- the second portion is the same as the first portion.
- the second portion is different from the first portion of processing resources.
- the second portion overlaps with the first portion and includes additional resources of the first FPGA.
- the OS maps the second portion of processing resources of the first FPGA into an address space of the second user process (block 630).
- the OS prevents other user processes from accessing the portion of processing resources of the first FPGA (block 635). After block 635, method 600 ends.
- a system receives multiple requests to program and execute one or more functions on a FPGA from multiple user processes (block 705).
- the system causes the FPGA to be partitioned with multiple partitions, with a partition for each user process making a request (block 710).
- the system allows each user process to access a corresponding partition of the FPGA, wherein multiple user processes simultaneously access the FPGA (block 715).
- an OS of the system maps each partition into the address space of a corresponding user process.
- FIG. 8 one implementation of a method 800 for controlling an FPGA compute engine is shown.
- a system receives, from a first user process, a first request to stop a first FPGA (block 805).
- the OS stops the first FPGA responsive to receiving the first request (block 810).
- the system receives, from the first user process, a second request to restart the first FPGA (block 815).
- the system restarts the FPGA responsive to receiving the second request (block 820).
- method 800 ends.
- a system assigns a shared FPGA to a first user process (block 905).
- the first user process programs the shared FPGA (block 910).
- the first user process provides input data to the shared FPGA (block 915).
- the first user process obtains results from the shared FPGA (block 920).
- the first user process releases the shared FPGA to be used by other user processes (block 925).
- method 900 ends.
- a computer accessible storage medium includes any storage media accessible by a computer during use to provide instructions and/or data to the computer.
- a computer accessible storage medium includes storage media such as magnetic or optical media, e.g., disk (fixed or removable), tape, CD-ROM, or DVD-ROM, CD-R, CD-RW, DVD-R, DVD-RW, or Blu-Ray.
- Storage media further includes volatile or non-volatile memory media such as RAM (e.g. synchronous dynamic RAM (SDRAM), double data rate (DDR, DDR2, DDR3, etc.) SDRAM, low-power DDR (LPDDR2, etc.) SDRAM, Rambus DRAM (RDRAM), static RAM (SRAM), etc.), ROM, Flash memory, non-volatile memory (e.g. Flash memory) accessible via a peripheral interface such as the Universal Serial Bus (USB) interface, etc.
- SDRAM synchronous dynamic RAM
- DDR double data rate SDRAM
- LPDDR2, etc. low-power DDR
- RDRAM Rambus DRAM
- SRAM static RAM
- ROM Flash memory
- non-volatile memory e.g. Flash memory
- USB
- program instructions include behavioral -level descriptions or register-transfer level (RTL) descriptions of the hardware functionality in a high level programming language such as C, or a design language (HDL) such as Verilog, VHDL, or database format such as GDS II stream format (GDSII).
- RTL register-transfer level
- HDL design language
- GDSII database format
- the description is read by a synthesis tool, which synthesizes the description to produce a netlist including a list of gates from a synthesis library.
- the netlist includes a set of gates, which also represent the functionality of the hardware including the system.
- the netlist is then placed and routed to produce a data set describing geometric shapes to be applied to masks.
- the masks are then used in various semiconductor fabrication steps to produce a semiconductor circuit or circuits corresponding to the system.
- the instructions on the computer accessible storage medium are the netlist (with or without the synthesis library) or the data set, as desired. Additionally, the instructions are utilized for purposes of emulation by a hardware based type emulator from such vendors as Cadence®, EVE®, and Mentor Graphics®.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Advance Control (AREA)
Abstract
Systems, apparatuses, and methods for sharing an field programmable gate array compute engine are disclosed. A system includes one or more processors and one or more FPGAs. The system receives a request, generated by a first user process, to allocate a portion of processing resources on a first FPGA. The system maps the portion of processing resources of the first FPGA into an address space of the first user process. The system prevents other user processes from accessing the portion of processing resources of the first FPGA. Later, the system detects a release of the portion of the processing resources on the first FPGA by the first user process. Then, the system receives a second request to allocate the first FPGA from a second user process. In response to the second request, the system maps the first FPGA into an address space of the second user process.
Description
SHAREABLE FPGA COMPUTE ENGINE
BACKGROUND [0001] The invention described herein was made with government support under PathForward Project with Lawrence Livermore National Security Prime Contract No. DE-AC52-07NA27344, Subcontract No. B620717 awarded by the United States Department of Energy. The United States Government has certain rights in the invention. Description of the Related Art
[0002] A field-programmable gate array (FPGA) is an integrated circuit device that is programmable by an end user after the FPGA is installed on a circuit board. In general, an FPGA includes an array of uncommitted circuit elements, which are called logic blocks. These logic blocks are connected together by interconnect resources making up a programmable interconnect fabric. The interconnect resources include logic gates that are inter-wired in multiple, different configurations. The logic blocks in the FPGA are configured to perform complex combinational or logic functions. In some examples, the logic blocks in an FPGA also include memory elements, which are implemented as flip-flops or more complete blocks of memory.
[0003] In an FPGA, the logic blocks can include elements such as lookup tables (LUTs) and other fixed functions that are programmed by inserting values into small Static Random Access Memories (SRAMs) or registers. The programming of the FPGA is performed before the logic blocks can be used. After programming, each combination of function inputs to an LUT results in a predefined output, allowing implementation of any logic function.
[0004] Although FPGAs are designed to be used as programmable logic engines in the general case, many times the overhead is high. For example, when the FPGA is shared by multiple processors running different computer programs, the repeated programming, inputting data and releasing steps performed for the FPGA consume an appreciable amount of time and resources. Therefore, the use of the FPGA reduces to being used as a fixed-function logic block in the usual deployment. This type of use reduces the flexible capability provided by the FPGA.
[0005] In view of the above, methods and systems for sharing an FPGA compute engine are desired.
BRIEF DESCRIPTION OF THE DRAWINGS
[0006] The advantages of the methods and mechanisms described herein may be better understood by referring to the following description in conjunction with the accompanying drawings, in which:
[0007] FIG. 1 is a block diagram of one implementation of a system.
[0008] FIG. 2 is a block diagram of one implementation of a cloud computing system.
[0009] FIG. 3 is a block diagram of one implementation of a FPGA card.
[0010] FIG. 4 is a block diagram of a system with a processor coupled to a FPGA.
[0011] FIG. 5 is a block diagram of a system with multiple processors coupled to multiple FPGAs.
[0012] FIG. 6 is a generalized flow diagram illustrating one implementation of a method for sharing an FPGA compute engine.
[0013] FIG. 7 is a generalized flow diagram illustrating another implementation of a method for sharing an FPGA compute engine.
[0014] FIG. 8 is a generalized flow diagram illustrating one implementation of a method for controlling an FPGA compute engine.
[0015] FIG. 9 is a generalized flow diagram illustrating one implementation of a method for utilizing a shared FPGA.
[0016] While the invention is susceptible to various modifications and alternative forms, specific implementations are shown by way of example in the drawings and are herein described in detail. It should be understood, however, that drawings and detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the invention is to cover all modifications, equivalents and alternatives falling within the scope of the present invention as defined by the appended claims.
DETAILED DESCRIPTION OF IMPLEMENTATIONS
[0017] In the following description, numerous specific details are set forth to provide a thorough understanding of the methods and mechanisms presented herein. However, one having ordinary skill in the art should recognize that the various implementations may be practiced without these specific details. In some instances, well-known structures, components, signals, computer program instructions, and techniques have not been shown in detail to avoid obscuring the approaches described herein. It will be appreciated that for simplicity and clarity of illustration,
elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements.
[0018] In various implementations, a system includes one or more processors, one or more memories and one or more field programmable gate arrays (FPGAs). The system receives a request to allocate a first FPGA. In some implementations, the request is generated by a first user process, and at least a first portion of processing resources of the first FPGA is mapped into an address space of the first user process. In some implementations, the first portion of processing resources are programmed by the first user process and input data is provided to the first FPGA. The system prevents other user processes different from the first process from accessing the first portion of processing resources of the first FPGA.
[0019] At a later point in time, results are conveyed from the first FPGA to the first user process, and the system detects a release of the first portion of the processing resources on the first FPGA by the first user process. Following, the system receives a second request from a second user process to allocate the first FPGA. In response to the second request, the system maps at least a second portion of processing resources of the first FPGA into an address space of the second user process. In some implementations, the second portion of processing resources is the same as the first portion of processing resources. In other implementations, the second portion of processing resources is different from the first portion of processing resources. Similar steps above for the first user process on the first portion of the processing resources of the first FPGA occur for the second user process on the second portion of processing resources of the first FPGA. Therefore, the first FPGA is not reduced to being used as a fixed-function logic block, but rather, the first FPGA is used as a programmable logic engine among multiple user processes.
[0020] Referring now to FIG. 1, a block diagram of one implementation of a system 100 is shown. System 100 includes clients 105A-105N, network 110, and cloud data center 125. In various implementations, cloud data center 125 includes any number and type of physical machines, such as computers and/or servers (e.g., database server, file server, application server), and any number and type of storage devices. The physical machines of cloud data center 125 include any number and type of processors for executing instructions and/or implementing logic and combinatorial resources. It is noted that in various other implementations, system 100 includes other components and/or the components are arranged differently.
[0021] Cloud data center 125 is representative of any type of computer cluster or collection of multiple physical machines that are connected and work together. For example, in one implementation, cloud 125 represents a cloud computing provider with multiple servers. In another implementation, cloud 125 represents a high performance computing (UPC) system with
multiple compute nodes. In a further implementation, cloud 125 represents a front-end/back-end system. In a still further implementation, cloud 125 represents a multi-layer system with multiple physical computers.
[0022] In one implementation, cloud data center 125 is configured to offer cloud computing resources to multiple organizations, companies, or individuals. Cloud computing is the delivery of computing as a service where shared resources, software, and information are provided to computers and other devices over a network. Cloud computing provides computation, software, data access, and data storage services. Many cloud computing infrastructures consist of services delivered through shared data centers and appear as a single point of access. In some implementations, cloud data center 125 includes a plurality of servers, including dynamically scalable or virtualized servers.
[0023] In various implementations, network 110 is any type of network or combination of networks, including wireless connection, direct local area network (LAN), metropolitan area network (MAN), wide area network (WAN), a Public Switched Telephone Network (PSTN), an Intranet, the Internet, a cable network, a packet-switched network, a fiber-optic network, a router, storage area network, or other type of network. Examples of LANs include Ethernet networks, Fiber Distributed Data Interface (FDDI) networks, and token ring networks. Network 110 further includes remote direct memory access (RDMA) hardware and/or software, transmission control protocol/internet protocol (TCP/IP) hardware and/or software, router, repeaters, switches, grids, and/or others. One or more of protocols such as Fibre Channel, Fibre Channel over Ethernet (FCoE), iSCSI, and so forth is used in network 110.
[0024] Clients 105A-105N are representative of any number of devices which are connected to cloud 125 via network 110. In various implementations, each of clients 105A-105N corresponds to any of various types of computer systems or computing devices, including, but not limited to, a personal computer system, desktop personal computer (PC), laptop or notebook computer, supercomputer, tablet, phone, smartphone, wearable device, personal digital assistant (PDA), mainframe computer system, handheld computer, workstation, network computer, a consumer device, load balancer, server, file server, application server, storage server, server farm or in general any type of computing system or device. Generally speaking, clients 105A-105N include one or more processors including one or more processor cores. Each processor core includes circuitry for executing instructions according to an instruction set architecture. The processor cores access cache memory subsystems for data and computer program instructions. The cache subsystems are coupled to a memory hierarchy including random access memory (RAM) and a storage device.
[0025] Turning now to FIG. 2, a block diagram of one implementation of a cloud computing system 200 is shown. Cloud computing system 200 includes a plurality of servers 205A-B, which are representative of any number and type of servers. In various implementations, server 205A-B includes a plurality of circuit boards, which are also referred to as cards. For example, server 205 A includes processor cards 210A-C and FPGA card 210D. Server 205 A also includes any number and type of other cards. Each card also includes memory and other logic in addition to processors or FPGAs. Similarly, server 205B includes processor cards 220A-C and FPGA card 220D. In some implementations, one or more of servers 205A-B includes an FPGA on a motherboard along with a processor in addition to FPGA cards 210D and 220D. In other implementations, one or more of servers 205 A-B includes an FPGA with a processor in an integrated processing unit in addition to FPGA cards 210D and 220D.
[0026] In one implementation, user processes executing on one of the processor cards 210A-C access and utilize the resources on FPGA card 210D. For example, a first user process executes an instruction to request FPGA resources from the operating system (OS). The OS enables access to the FPGA resources by mapping the FPGA resources into the address space of the first user process in response to receiving the request. Then, the first user process programs one or more FPGAs, configures the programmed FPGAs, and then transfers data to be processed by the programmed and configured FPGAs. The FPGAs write the processed data to a memory location in the address space of the first user process. Then, the first user process retrieves the data. User processes are able to start the FPGA and stop the FPGA by executing a specific instruction, writing to a given register, or by making a request to the OS. User processes are also able to change the clock speed or other performance and power parameters of the FPGA while the FPGA is under control of the user process.
[0027] After the first user process retrieves the processed data, the first user process returns control of the FPGAs to the OS. Then, in some implementations, other user processes executing on processor cards 210A-C request and utilize the FPGA resources for subsequent computation. Multiple user processes are able to access the same FPGA resources using these techniques. In other implementations, other suitable techniques for sharing FPGA resources among a plurality of user processes are possible and are contemplated.
[0028] Referring now to FIG. 3, a block diagram of one implementation of a FPGA card 300 is shown. In one implementation, FPGA card 300 includes interconnect 310, interconnect logic 315, memory 330, FPGAs 335A-N, peripheral device(s) 340, and JTAG interface 345. Interconnect 310 is representative of any type of interconnect for interfacing with processor cards (e.g., processor cards 210A-C of FIG. 2) and/or with other components. In one implementation,
interconnect 310 is a PCIe interconnect. In another implementation, interconnect 310 is a Gen-Z compatible interconnect. In another implementation, interconnect 310 is a CCIX compatible interconnect. Although the components of FPGA card 300 are illustrated as being on a card, in other implementations one or more of the components are integrated on a motherboard or integrated within a processing unit package.
[0029] Interconnect logic 315 interfaces between interconnect 310, accelerators 335A-N, and memory 330. In various implementations, interconnect logic 315 is implemented using an FPGA, a programmable logic device, or another device. In one implementation, interconnect logic 315 includes registers 320 and queue 325. In another implementation, interconnect logic 315 includes only registers 320 without queues 325. Alternatively, in a further implementation, interconnect logic 315 includes only queues 325 without registers 320.
[0030] In one implementation, user processes executing on a processor card interface with one or more FPGAs 335A-N via registers 320 and/or queues 325. For example, when a user process executes an instruction to program a given FPGA 335, the instruction causes a value to be written to first register of registers 320 to initiate the programming process. The instruction also writes a value into a second register of registers 320 to indicate where a bitfile 333 is stored, wherein the bitfile is used for programming the given FPGA 335. For example, in one implementation, the user process stores bitfile 333 in memory 330, and the user process specifies that bitfile 333 should be used to program the given FPGA 335.
[0031] In another implementation, a library of functions are provided for a user to select from for generating bitfiles to program FPGAs 335. For example, different neural network functions, machine learning functions, compression functions, encryption functions, fast fourier transform (FFT) functions, and/or other types of functions are provided in this library. In an implementation, the user process selects from and/or combines various functions from the library to generate bitfiles for programming FPGAs 335A-N. The user process then provides their own data to be processed by the programmed FPGAs 335A-N. In some cases, the user combines functions selected from the library with unique logic provided by the user to generate bitfiles. Other variations of techniques for generating bitfiles are possible and are contemplated.
[0032] FPGAs 335A-N are representative of any number and type of programmable devices, accelerator devices, or other types of devices. In one implementation, multiple user processes utilize different partitions of a given FPGA 335. For example, the given FPGA 335 are programmed with a bitfile, and then different user processes access different partitions of the given FPGA 335 for use in processing different datasets.
[0033] Turning now to FIG. 4, a block diagram of one implementation of a system 400 is shown. System 400 includes at least processor 410 and interface 420 coupled to interface 430 and FPGA 440. FPGA 440 is representative of any type of programmable device, accelerator, or other similar component. In other implementations, FPGA 440 is one of multiple other types of devices (e.g., application specific integrated circuit (ASIC), graphics processing unit (GPU), digital signal processor (DSP)).
[0034] Interfaces 420 and 430 are representative of any type of interface. In one implementation, interfaces 420 and 430 are Peripheral Component Interconnect Express (PCIe) interfaces. In some implementations, system 400 supports resources in FPGA 440 where the hardware functions are altered by the requesting program executing on processor 410. System 400 allows for virtualization, partitioning, sequential sharing, and recovery of resources on FPGA 440. In one implementation, FPGA 440 presents one physical function to processor 410 for control purposes. In this implementation, FPGA 440 presents multiple virtual functions to processor 410 for programming and use.
[0035] Referring now to FIG. 5, a block diagram of one implementation of a system 500 is shown. System 500 includes processors 505 and 515 coupled to switch/interconnect 525 via interfaces 506 and 516, respectively. System 500 also FPGAs 540 and 560 coupled to switch/interconnect 525 via interfaces 530 and 550, respectively. FPGAs 540 and 560 are representative of any number and type of programmable devices or accelerator devices.
[0036] In an implementation, each one of FPGAs 540 and 560 is partitioned by the operating system using the physical function. Each partition is presented to user processes executing on processors 505 and/or 515 using conventional memory management hardware. Furthermore, each partition is shared among multiple processes executing on processors 505 and/or 515 using multiple mappings of memory management hardware. User processes executing on processors 505 and/or 515 program FPGAs 540 and 560, feed data to FPGAs 540 and 560, obtain results from FPGAs 540 and 560, and release FPGAs 540 and 560 to be used by another user process.
[0037] In one implementation, system 500 is a distributed computing system (e.g., cluster). For example, in one implementation, subscribers to a cloud service are able to access resources in the FPGAs 540 and 560 from programs executing on processors 505 and/or 515.
[0038] Turning now to FIG. 6, one implementation of a method 600 for sharing a FPGA compute engine is shown. For purposes of discussion, the steps in this implementation and those of FIG. 7-8 are shown in sequential order. However, it is noted that in various implementations of the described methods, one or more of the elements described are performed concurrently, in a different order than shown, or are omitted entirely. Other additional elements are also performed
as desired. Any of the various systems or apparatuses described herein are configured to implement method 600.
[0039] An operating system (OS) receives a request to utilize at least a first portion of processing resources on a first FPGA, wherein the request is generated by a first user process (block 605). It is noted that in other implementations, the system includes any number of FPGAs in addition to the first FPGA. In some cases, the first user process requests the resources of multiple FPGAs. Next, the OS maps the first portion of processing resources of the first FPGA into an address space of the first user process (block 610). Then, the OS prevents other user processes from accessing the first portion of processing resources of the first FPGA (block 615).
[0040] At a later point in time, the OS detects a request to release the first portion of the processing resources on the first FPGA by the first user process (block 620). Next, the OS receives a request to utilize at least a second portion of the processing resources on the first FPGA, wherein the request is generated by a second user process (block 625). It is noted that in an implementation, the second portion is the same as the first portion. Alternatively, in other implementations, the second portion is different from the first portion of processing resources. In yet other implementations, the second portion overlaps with the first portion and includes additional resources of the first FPGA.
[0041] Then, the OS maps the second portion of processing resources of the first FPGA into an address space of the second user process (block 630). Next, the OS prevents other user processes from accessing the portion of processing resources of the first FPGA (block 635). After block 635, method 600 ends.
[0042] Referring now to FIG. 7, another implementation of a method 700 for sharing a FPGA compute engine is shown. A system receives multiple requests to program and execute one or more functions on a FPGA from multiple user processes (block 705). The system causes the FPGA to be partitioned with multiple partitions, with a partition for each user process making a request (block 710). Then, the system allows each user process to access a corresponding partition of the FPGA, wherein multiple user processes simultaneously access the FPGA (block 715). For example, an OS of the system maps each partition into the address space of a corresponding user process. After block 715, method 700 ends.
[0043] Turning now to FIG. 8, one implementation of a method 800 for controlling an FPGA compute engine is shown. A system receives, from a first user process, a first request to stop a first FPGA (block 805). Next, the OS stops the first FPGA responsive to receiving the first request (block 810). At a later point in time, the system receives, from the first user process, a
second request to restart the first FPGA (block 815). Then, the system restarts the FPGA responsive to receiving the second request (block 820). After block 820, method 800 ends.
[0044] Referring now to FIG. 9, one implementation of a method 900 for utilizing a shared FPGA is shown. A system assigns a shared FPGA to a first user process (block 905). The first user process programs the shared FPGA (block 910). Then, the first user process provides input data to the shared FPGA (block 915). Next, the first user process obtains results from the shared FPGA (block 920). Then, the first user process releases the shared FPGA to be used by other user processes (block 925). After block 925, method 900 ends.
[0045] It is noted that one or more of the above-described implementations include software. In such implementations, the program instructions that implement the methods and/or mechanisms are conveyed or stored on a computer readable medium. Numerous types of media which are configured to store program instructions are available and include hard disks, floppy disks, CD- ROM, DVD, flash memory, Programmable ROMs (PROM), random access memory (RAM), and various other forms of volatile or non-volatile storage. Generally speaking, a computer accessible storage medium includes any storage media accessible by a computer during use to provide instructions and/or data to the computer. For example, a computer accessible storage medium includes storage media such as magnetic or optical media, e.g., disk (fixed or removable), tape, CD-ROM, or DVD-ROM, CD-R, CD-RW, DVD-R, DVD-RW, or Blu-Ray. Storage media further includes volatile or non-volatile memory media such as RAM (e.g. synchronous dynamic RAM (SDRAM), double data rate (DDR, DDR2, DDR3, etc.) SDRAM, low-power DDR (LPDDR2, etc.) SDRAM, Rambus DRAM (RDRAM), static RAM (SRAM), etc.), ROM, Flash memory, non-volatile memory (e.g. Flash memory) accessible via a peripheral interface such as the Universal Serial Bus (USB) interface, etc. Storage media includes microelectromechanical systems (MEMS), as well as storage media accessible via a communication medium such as a network and/or a wireless link.
[0046] Additionally, in various implementations, program instructions include behavioral -level descriptions or register-transfer level (RTL) descriptions of the hardware functionality in a high level programming language such as C, or a design language (HDL) such as Verilog, VHDL, or database format such as GDS II stream format (GDSII). In some cases the description is read by a synthesis tool, which synthesizes the description to produce a netlist including a list of gates from a synthesis library. The netlist includes a set of gates, which also represent the functionality of the hardware including the system. The netlist is then placed and routed to produce a data set describing geometric shapes to be applied to masks. The masks are then used in various semiconductor fabrication steps to produce a semiconductor circuit or circuits corresponding to
the system. Alternatively, the instructions on the computer accessible storage medium are the netlist (with or without the synthesis library) or the data set, as desired. Additionally, the instructions are utilized for purposes of emulation by a hardware based type emulator from such vendors as Cadence®, EVE®, and Mentor Graphics®.
[0047] Although the implementations above have been described in considerable detail, numerous variations and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated. It is intended that the following claims be interpreted to embrace all such variations and modifications.
Claims
1. A system comprising:
one or more processors;
one or more memories; and
one or more field programmable gate arrays (FPGAs);
wherein the system is configured to:
receive a request to allocate at least a portion of processing resources on a first
FPGA, wherein the request is generated by a first user process;
map the portion of processing resources of the first FPGA into an address space of the first user process; and
prevent other user processes from accessing the portion of processing resources of the first FPGA.
2. The system as recited in claim 1, wherein a processor of the one or more processors is
configured to:
detect a release of the portion of the processing resources on the first FPGA by the first user process;
receive a request to allocate at least a portion of the processing resources on the first FPGA, wherein the request is generated by a second user process; map the portion of processing resources of the first FPGA into an address space of the second user process; and
prevent other user processes from accessing the portion of processing resources of the first FPGA.
3. The system as recited in claim 1, wherein the system is configured to:
receive multiple requests to program and execute one or more functions on a second
FPGA from multiple user processes; and
program the second FPGA to create multiple partitions, with a partition for each user process making a request.
4. The system as recited in claim 3, wherein the system is configured to allow each user process to access a corresponding partition of the second FPGA, wherein multiple user processes simultaneously access the second FPGA
5. The system as recited in claim 1, wherein the system is configured to:
receive, from the first user process, a first request to stop the first FPGA; and
stop the first FPGA responsive to receiving the first request.
6. The system as recited in claim 5, wherein the system is configured to:
receive, from the first user process, a second request to restart the first FPGA; and restart the first FPGA responsive to receiving the second request.
7. The system as recited in claim 1, wherein the system is configured to:
assign the first FPGA to the first user process, wherein the first FPGA is shared by one or more other user processes;
program, by the first user process, the first FPGA;
provide input data to the first FPGA; and
convey results from the first FPGA to the first user process.
8. The system as recited in claim 7, wherein in response to conveying the results to the first user process, the system is configured to release the first FPGA to be used by the one or more other user processes.
9. A method comprising:
receiving a request to allocate at least a portion of processing resources on a first field programmable gate array (FPGA), wherein the request is generated by a first user process;
mapping the portion of processing resources of the first FPGA into an address space of the first user process; and
preventing other user processes from accessing the portion of processing resources of the first FPGA.
10. The method as recited in claim 9, further comprising:
detecting a release of the portion of the processing resources on the first FPGA by the first user process;
receiving a request to allocate at least a portion of the processing resources on the first FPGA, wherein the request is generated by a second user process; mapping the portion of processing resources of the first FPGA into an address space of the second user process; and
preventing other user processes from accessing the portion of processing resources of the first FPGA.
11. The method as recited in claim 9, further comprising:
receiving multiple requests to program and execute one or more functions on a second
FPGA from multiple user processes; and
programming the second FPGA to create multiple partitions, with a partition for each user process making a request.
12. The method as recited in claim 11, further comprising allowing each user process to access a corresponding partition of the second FPGA, wherein multiple user processes simultaneously access the second FPGA.
13. The method as recited in claim 9, further comprising:
receiving, from the first user process, a first request to stop the first FPGA; and stopping the first FPGA responsive to receiving the first request.
14. The method as recited in claim 13, further comprising:
receiving, from the first user process, a second request to restart the first FPGA; and restarting the FPGA responsive to receiving the second request.
15. The method as recited in claim 9, further comprising:
assigning the first FPGA to the first user process, wherein the first FPGA is shared by one or more other user processes;
programming, by the first user process, the first FPGA;
providing input data to the first FPGA; and
conveying results from the first FPGA to the first user process.
16. The method as recited in claim 15, wherein in response to conveying the results to the first user process, the method further comprises releasing the first FPGA to be used by the one or more other user processes.
17. A non-transitory computer readable storage medium storing program instructions, wherein the program instructions are executable by a processor to:
receive a request to allocate at least a portion of processing resources on a first field
programmable gate array (FPGA) of one or more FPGAs, wherein the request is generated by a first user process;
map the portion of processing resources of the first FPGA into an address space of the first user process; and
prevent other user processes from accessing the portion of processing resources of the first FPGA.
18. The non-transitory computer readable storage medium as recited in claim 17, wherein the program instructions are further executable by a processor to:
detect a release of the portion of the processing resources on the first FPGA by the first user process;
receive a request to allocate at least a portion of the processing resources on the first FPGA, wherein the request is generated by a second user process; map the portion of processing resources of the first FPGA into an address space of the second user process; and
prevent other user processes from accessing the portion of processing resources of the first FPGA.
19. The non-transitory computer readable storage medium as recited in claim 17, wherein the program instructions are further executable by a processor to:
receive multiple requests to program and execute one or more functions on a second
FPGA from multiple user processes; and
program the second FPGA to create multiple partitions, with a partition for each user process making a request.
20. The non-transitory computer readable storage medium as recited in claim 19, wherein the program instructions are further executable by a processor to allow each user process to access a corresponding partition of the second FPGA, wherein multiple user processes simultaneously access the second FPGA.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201762540217P | 2017-08-02 | 2017-08-02 | |
| US62/540,217 | 2017-08-02 | ||
| US15/974,014 US10970118B2 (en) | 2017-08-02 | 2018-05-08 | Shareable FPGA compute engine |
| US15/974,014 | 2018-05-08 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019027554A1 true WO2019027554A1 (en) | 2019-02-07 |
Family
ID=65230258
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2018/035377 Ceased WO2019027554A1 (en) | 2017-08-02 | 2018-05-31 | Shareable fpga compute engine |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US10970118B2 (en) |
| WO (1) | WO2019027554A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021051714A1 (en) * | 2019-09-21 | 2021-03-25 | 苏州浪潮智能科技有限公司 | Fpga cloud platform acceleration resource allocation method, and system |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104657211A (en) * | 2015-02-03 | 2015-05-27 | 百度在线网络技术(北京)有限公司 | Method and equipment used for operating target application on corresponding equipment |
| US11086815B1 (en) * | 2019-04-15 | 2021-08-10 | Xilinx, Inc. | Supporting access to accelerators on a programmable integrated circuit by multiple host processes |
| US11422812B2 (en) | 2019-06-25 | 2022-08-23 | Advanced Micro Devices, Inc. | Method and apparatus for efficient programmable instructions in computer systems |
| US20220321403A1 (en) * | 2021-04-02 | 2022-10-06 | Nokia Solutions And Networks Oy | Programmable network segmentation for multi-tenant fpgas in cloud infrastructures |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130346985A1 (en) * | 2012-06-20 | 2013-12-26 | Microsoft Corporation | Managing use of a field programmable gate array by multiple processes in an operating system |
Family Cites Families (63)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4481573A (en) | 1980-11-17 | 1984-11-06 | Hitachi, Ltd. | Shared virtual address translation unit for a multiprocessor system |
| US4779188A (en) | 1983-12-14 | 1988-10-18 | International Business Machines Corporation | Selective guest system purge control |
| US5230045A (en) | 1986-11-12 | 1993-07-20 | Xerox Corporation | Multiple address space system including address translator for receiving virtual addresses from bus and providing real addresses on the bus |
| US5123101A (en) | 1986-11-12 | 1992-06-16 | Xerox Corporation | Multiple address space mapping technique for shared memory wherein a processor operates a fault handling routine upon a translator miss |
| US5644748A (en) | 1992-01-30 | 1997-07-01 | Fujitsu Limited | Processor system including an index buffer circuit and a translation look-aside buffer control circuit for processor-to-processor interfacing |
| US5493660A (en) | 1992-10-06 | 1996-02-20 | Hewlett-Packard Company | Software assisted hardware TLB miss handler |
| US6356989B1 (en) | 1992-12-21 | 2002-03-12 | Intel Corporation | Translation lookaside buffer (TLB) arrangement wherein the TLB contents retained for a task as swapped out and reloaded when a task is rescheduled |
| JP2819982B2 (en) | 1993-03-18 | 1998-11-05 | 株式会社日立製作所 | Multiprocessor system with cache match guarantee function that can specify range |
| JPH0784883A (en) | 1993-09-17 | 1995-03-31 | Hitachi Ltd | Virtual computer system address translation buffer purging method |
| US5740417A (en) | 1995-12-05 | 1998-04-14 | Motorola, Inc. | Pipelined processor operating in different power mode based on branch prediction state of branch history bit encoded as taken weakly not taken and strongly not taken states |
| US5897664A (en) | 1996-07-01 | 1999-04-27 | Sun Microsystems, Inc. | Multiprocessor system having mapping table in each node to map global physical addresses to local physical addresses of page copies |
| US6681239B1 (en) | 1996-12-23 | 2004-01-20 | International Business Machines Corporation | Computer system having shared address space among multiple virtual address spaces |
| US6266753B1 (en) | 1997-07-10 | 2001-07-24 | Cirrus Logic, Inc. | Memory manager for multi-media apparatus and method therefor |
| US5949423A (en) | 1997-09-30 | 1999-09-07 | Hewlett Packard Company | Z buffer with degree of visibility test |
| US6226012B1 (en) | 1998-04-02 | 2001-05-01 | Nvidia Corporation | Method and apparatus for accelerating the rendering of graphical images |
| US6239808B1 (en) | 1998-04-03 | 2001-05-29 | Nvidia Corporation | Method and apparatus for determining texture values of graphical images |
| US6266064B1 (en) | 1998-05-29 | 2001-07-24 | Microsoft Corporation | Coherent visibility sorting and occlusion cycle detection for dynamic aggregate geometry |
| US6801207B1 (en) | 1998-10-09 | 2004-10-05 | Advanced Micro Devices, Inc. | Multimedia processor employing a shared CPU-graphics cache |
| JP3819166B2 (en) | 1998-11-27 | 2006-09-06 | ヒタチグローバルストレージテクノロジーズネザーランドビーブイ | Energy consumption reduction method |
| US6510525B1 (en) | 1999-04-26 | 2003-01-21 | Mediaq, Inc. | Method and apparatus to power up an integrated device from a low power state |
| US6825848B1 (en) | 1999-09-17 | 2004-11-30 | S3 Graphics Co., Ltd. | Synchronized two-level graphics processing cache |
| US6819321B1 (en) | 2000-03-31 | 2004-11-16 | Intel Corporation | Method and apparatus for processing 2D operations in a tiled graphics architecture |
| DE60041444D1 (en) | 2000-08-21 | 2009-03-12 | Texas Instruments Inc | microprocessor |
| EP1182567B1 (en) | 2000-08-21 | 2012-03-07 | Texas Instruments France | Software controlled cache configuration |
| US6842180B1 (en) | 2000-09-20 | 2005-01-11 | Intel Corporation | Opportunistic sharing of graphics resources to enhance CPU performance in an integrated microprocessor |
| US6988214B1 (en) | 2000-11-06 | 2006-01-17 | Dell Products L.P. | Processor power state transistions using separate logic control |
| US6801208B2 (en) | 2000-12-27 | 2004-10-05 | Intel Corporation | System and method for cache sharing |
| US7030877B1 (en) | 2002-03-04 | 2006-04-18 | Advanced Micro Devices, Inc. | Computer graphics processing system, computer memory, and method of use with computer graphics processing system utilizing hierarchical image depth buffer |
| US6954864B2 (en) | 2002-03-29 | 2005-10-11 | Intel Corporation | Method and apparatus for remotely placing a computing device into a low power state |
| US6891543B2 (en) | 2002-05-08 | 2005-05-10 | Intel Corporation | Method and system for optimally sharing memory between a host processor and graphics processor |
| EP1391820A3 (en) | 2002-07-31 | 2007-12-19 | Texas Instruments Incorporated | Concurrent task execution in a multi-processor, single operating system environment |
| US6895491B2 (en) | 2002-09-26 | 2005-05-17 | Hewlett-Packard Development Company, L.P. | Memory addressing for a virtual machine implementation on a computer processor supporting virtual hash-page-table searching |
| US7152169B2 (en) | 2002-11-29 | 2006-12-19 | Intel Corporation | Method for providing power management on multi-threaded processor by using SMM mode to place a physical processor into lower power state |
| US7360056B2 (en) | 2003-04-04 | 2008-04-15 | Sun Microsystems, Inc. | Multi-node system in which global address generated by processing subsystem includes global to local translation information |
| US7363462B2 (en) | 2003-04-04 | 2008-04-22 | Sun Microsystems, Inc. | Performing virtual to global address translation in processing subsystem |
| US7200762B2 (en) | 2003-09-30 | 2007-04-03 | Intel Corporation | Providing a low-power state processor voltage in accordance with a detected processor type |
| US7159766B2 (en) | 2004-01-20 | 2007-01-09 | Standard Microsystems Corporation | Peripheral device feature allowing processors to enter a low power state |
| US7023445B1 (en) | 2004-04-12 | 2006-04-04 | Advanced Micro Devices, Inc. | CPU and graphics unit with shared cache |
| JP4576172B2 (en) | 2004-07-29 | 2010-11-04 | 富士通株式会社 | Arithmetic processing device, information processing device, and control method of arithmetic processing device |
| US7213125B2 (en) | 2004-07-31 | 2007-05-01 | Hewlett-Packard Development Company, L.P. | Method for patching virtually aliased pages by a virtual-machine monitor |
| US7383423B1 (en) | 2004-10-01 | 2008-06-03 | Advanced Micro Devices, Inc. | Shared resources in a chip multiprocessor |
| US7398371B2 (en) | 2005-06-23 | 2008-07-08 | Qualcomm Incorporated | Shared translation look-aside buffer and method |
| US20060294288A1 (en) | 2005-06-24 | 2006-12-28 | Rohit Seth | System and method for using protection keys to emulate a large region identifier space |
| US7383415B2 (en) | 2005-09-09 | 2008-06-03 | Sun Microsystems, Inc. | Hardware demapping of TLBs shared by multiple threads |
| US8607008B1 (en) | 2006-11-01 | 2013-12-10 | Nvidia Corporation | System and method for independent invalidation on a per engine basis |
| US8645666B2 (en) | 2006-12-28 | 2014-02-04 | Intel Corporation | Means to share translation lookaside buffer (TLB) entries between different contexts |
| US20090150696A1 (en) | 2007-12-10 | 2009-06-11 | Justin Song | Transitioning a processor package to a low power state |
| GB2455744B (en) | 2007-12-19 | 2012-03-14 | Advanced Risc Mach Ltd | Hardware driven processor state storage prior to entering a low power mode |
| US7941631B2 (en) | 2007-12-28 | 2011-05-10 | Intel Corporation | Providing metadata in a translation lookaside buffer (TLB) |
| US8028185B2 (en) | 2008-03-11 | 2011-09-27 | Globalfoundries Inc. | Protocol for transitioning in and out of zero-power state |
| US8108650B2 (en) | 2009-05-29 | 2012-01-31 | Apple Inc. | Translation lookaside buffer (TLB) with reserved areas for specific sources |
| US8364933B2 (en) | 2009-12-18 | 2013-01-29 | International Business Machines Corporation | Software assisted translation lookaside buffer search mechanism |
| US8930674B2 (en) | 2012-03-07 | 2015-01-06 | Soft Machines, Inc. | Systems and methods for accessing a unified translation lookaside buffer |
| CN103577266B (en) * | 2012-07-31 | 2017-06-23 | 国际商业机器公司 | For the method and system being allocated to field programmable gate array resource |
| US9009446B2 (en) | 2012-08-02 | 2015-04-14 | Oracle International Corporation | Using broadcast-based TLB sharing to reduce address-translation latency in a shared-memory system with electrical interconnect |
| US9619284B2 (en) | 2012-10-04 | 2017-04-11 | Intel Corporation | Dynamically switching a workload between heterogeneous cores of a processor |
| US9323692B2 (en) | 2014-04-17 | 2016-04-26 | International Business Machines Corporation | Managing translation of a same address across multiple contexts using a same entry in a translation lookaside buffer |
| US9405702B2 (en) | 2014-11-14 | 2016-08-02 | Cavium, Inc. | Caching TLB translations using a unified page table walker cache |
| US11100004B2 (en) | 2015-06-23 | 2021-08-24 | Advanced Micro Devices, Inc. | Shared virtual address space for heterogeneous processors |
| US9940166B2 (en) * | 2015-07-15 | 2018-04-10 | Bank Of America Corporation | Allocating field-programmable gate array (FPGA) resources |
| US9892058B2 (en) | 2015-12-16 | 2018-02-13 | Advanced Micro Devices, Inc. | Centrally managed unified shared virtual address space |
| US10275558B2 (en) * | 2016-11-07 | 2019-04-30 | Intel Corporation | Technologies for providing FPGA infrastructure-as-a-service computing capabilities |
| US10404470B2 (en) * | 2017-01-13 | 2019-09-03 | Microsoft Technology Licensing, Llc | Signature verification of field-programmable gate array programs |
-
2018
- 2018-05-08 US US15/974,014 patent/US10970118B2/en active Active
- 2018-05-31 WO PCT/US2018/035377 patent/WO2019027554A1/en not_active Ceased
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130346985A1 (en) * | 2012-06-20 | 2013-12-26 | Microsoft Corporation | Managing use of a field programmable gate array by multiple processes in an operating system |
Non-Patent Citations (2)
| Title |
|---|
| BYMA STUART ET AL: "FPGAs in the Cloud: Booting Virtualized Hardware Accelerators with OpenStack", 2014 IEEE 22ND ANNUAL INTERNATIONAL SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES, IEEE, 11 May 2014 (2014-05-11), pages 109 - 116, XP032778900, DOI: 10.1109/FCCM.2014.42 * |
| XIA TIAN ET AL: "Hypervisor mechanisms to manage FPGA reconfigurable accelerators", 2016 INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE TECHNOLOGY (FPT), IEEE, 7 December 2016 (2016-12-07), pages 44 - 52, XP033098824, DOI: 10.1109/FPT.2016.7929187 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021051714A1 (en) * | 2019-09-21 | 2021-03-25 | 苏州浪潮智能科技有限公司 | Fpga cloud platform acceleration resource allocation method, and system |
| US11789778B2 (en) | 2019-09-21 | 2023-10-17 | Inspur Suzhou Intelligent Technology Co., Ltd. | FPGA cloud platform acceleration resource allocation method, and system |
Also Published As
| Publication number | Publication date |
|---|---|
| US20190042313A1 (en) | 2019-02-07 |
| US10970118B2 (en) | 2021-04-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3234798B1 (en) | System on a chip comprising multiple compute sub-systems | |
| EP3234797B1 (en) | System on a chip comprising reconfigurable resources for multiple compute sub-systems | |
| CN110063051B (en) | System and method for reconfiguring server and server | |
| US10970118B2 (en) | Shareable FPGA compute engine | |
| JP7200078B2 (en) | System-on-chip with I/O steering engine | |
| EP3256953B1 (en) | Multi-mode system on a chip | |
| US11003618B1 (en) | Out-of-band interconnect control and isolation | |
| US11360789B2 (en) | Configuration of hardware devices | |
| US11481255B2 (en) | Management of memory pages for a set of non-consecutive work elements in work queue designated by a sliding window for execution on a coherent accelerator | |
| US10909044B2 (en) | Access control device, access control method, and recording medium containing access control program | |
| US20190188069A1 (en) | Dual physical-channel systems firmware initialization and recovery | |
| CN113396402A (en) | Method and apparatus for controlling memory processing | |
| CN120188143A (en) | VM migration using memory pointers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18737055 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 18737055 Country of ref document: EP Kind code of ref document: A1 |