19–21 Nov 2026
"Alexandru Ioan Cuza" University of Iasi and "Gheorghe Asachi" Technical University of Iași
Europe/Bucharest timezone

Bridging FPGA-Accelerated Inference and Cloud-Native Environments: A CPU-Driven Approach

20 Nov 2026, 14:45
15m
Room 1

Room 1

Paper presentation Cloud Computing and Network Virtualisation Cloud Computing and Network Virtualisation

Speaker

Alin-Tudor Sferle (Technical University of Cluj-Napoca)

Description

The use of ML has grown considerably over the last period, leading to multiple levels of services offered on a cloud platform. An example is Inference as a Service, which offers a pre-developed tool that can directly do predictions based on a pre-trained model. Based on our previous work related to the Cloud-Native (CN)-like attachment of FPGA, we analyze the performance obtained by relying on a simpler methodology to bridge FPGA-accelerated Gradient Boosted Decision Trees (GBDT) inference and CN-like environments to enable the creation of ML inference services in small and cost-constrained bare-metal cloud deployments. This paper aims to expose the advantages, disadvantages and the performance obtained by using such a simplified bridging methodology, based on an FPGA-based inference and translation between the CPU subsystem and the FPGA region without relying on DMA-based transfers.

Authors

Alin-Tudor Sferle (Technical University of Cluj-Napoca) Dr Iustin-Alexandru Ivanciu (Technical University of Cluj-Napoca) Daniel Zinca (Technical University of Cluj-Napoca) Prof. Virgil Dobrota (Technical University of Cluj-Napoca)

Presentation materials