Speaker
Description
The use of ML has grown considerably over the last period, leading to multiple levels of services offered on a cloud platform. An example is Inference as a Service, which offers a pre-developed tool that can directly do predictions based on a pre-trained model. Based on our previous work related to the Cloud-Native (CN)-like attachment of FPGA, we analyze the performance obtained by relying on a simpler methodology to bridge FPGA-accelerated Gradient Boosted Decision Trees (GBDT) inference and CN-like environments to enable the creation of ML inference services in small and cost-constrained bare-metal cloud deployments. This paper aims to expose the advantages, disadvantages and the performance obtained by using such a simplified bridging methodology, based on an FPGA-based inference and translation between the CPU subsystem and the FPGA region without relying on DMA-based transfers.