Development of a heterogeneous computing platform based on IBM’s DOME MicroDataCenter and cloudPFGA high-performance computing platforms

Javier
Javier
Last updated 
As CTO & Head of Product at DC-ONE AG (later called GRAPIN AG), Javier was in charge of developing a cutting-edge technology platform for heterogeneous computing based on IBM’s Research Europe Zürich DOME MicroDataCenter and cloudFPGA high-performance computing platforms.
IBM’s DOME MicroDataCenter 1.22 MB View full-size Download

As an FPGA expert, Javier was in charge of holding technical discussions with IBM’s cloudFPGA team lead for scoping the platform redesign to bring IBM’s prototype to be production-ready. As a product designer, Javier worked together with IBM’s cloudFPGA Department Head (Cloud and Computing Infrastructure) and Business Development Executives to deal with all sort of business and collaboration aspects. Additionally, Javier was involved in the following activities:
  • Development of a proprietary platform for heterogeneous computing based on modern single-source SYCL/DPC++ programming models and Jupyter notebooks,
  • Development of an FPGA model-composer proprietary platform using MATLAB, Simulink, SystemGenerator, and DSP Builder,
  • Development of a FPGA-PoC application implementing blockchain consensus algorithms based on cryptonight AES algorithms,
  • Cloud platform evaluation with RedHat and Mirantis,
  • Project management with Shape Up and Basecamp.

Heterogeneous computing

Obtaining high compute performance on today’s modern computer architectures requires code that is optimized, power-efficient, and scalable. The demand for high performance continues to increase due to needs in AI, video analytics, data analytics, as well as in traditional high-performance computing (HPC). Modern workload diversity has resulted in a need for architectural diversity; no single architecture is best for every workload. A mix of scalar, vector, matrix, and spatial (SVMS) architectures deployed in CPU, GPU, AI, and FPGA accelerators are required to extract the needed performance.

High-performance computing

  • Practice of aggregating computing power in a way that delivers much higher performance than typical desktop computers or workstations.
  • Highly complex computations and data-intensive modeling.
  • Entire solution stack: compute, data storage systems, networking, management software, and end-user computational applications
High-performance computing as a service (HPCaaS):
  • Management of HPC resources is a very tedious task for enterprises due to high deployment and maintenance costs.
  • HPCaaS overcomes this challenge by providing the enterprises processing power on-demand, and
  • Enables organizations to build their own virtual machines (VMs) delivering advantages such as availability, scalability, agility, flexibility, and reliability.

DOME MicroDataCenter

For more details please visit DOME MicroDataCenter’s Wikipedia entry.

cloudFPGA

The content presented here is entirely based on public materials that the IBM Research Europe Zürich and its cloudFPGA team have shared with the scientific community through their profile on Researchgate.
  1. Preface
  2. Introduction
  3. Platform
  4. Management framework
  5. Development kit
  6. Cloud services and applications
  7. Network and storage acceleration
  8. Benchmarks
  9. Background Material
    1. DOME MicroDataCenter
    2. How do you squeeze 1000 FPGAs into a DC rack?
    3. ResearchGate
      1. An FPGA Platform for hyperscalers
      2. An FPGA Platform for hyperscalers (slides)
      3. Enabling FPGAs in hyperscale datacenters
      4. Disaggregated FPGAs: network performance comparison against bare-metal servers, virtual machines and Linux containers
      5. Network-attached FPGAs for datacenter applications
      6. Integrating network-attached FPGAs into the cloud using partial reconfiguration
      7. System architecture for network-attached FPGAs in the cloud using partial reconfiguration
      8. A unified programming model for reconfigurable heterogeneous computing clusters (paper and slides)
    4. Promoting FPGAs to became 1st class-citizens in datacenters (IBM’s live presentation and summary)
    5. openRole: Do we need POSIX for FPGAs (IBM’s live presentation)

Field programmable gate arrays and HPC

  1. High-Performance Computing Using FPGAs
  2. FPGAs in the datacenter
  3. Use cases
    1. CERN: Artificial Intelligence accelerates dark matter search
    2. Munich Leukemia Lab

Annex