Optimizing a Hardware Network Stack to Realize an In-Network ML Inference Application

Workshop:H2RC: Seventh International Workshop on Heterogeneous High-Performance Reconfigurable Computing

Authors: Marco Hartmann, Lukas Max Weber, Johannes Wirth, Lukas Sommer, and Andreas Koch (Technical University of Darmstadt)

Abstract: FPGAs are an interesting platform for the implementation of network-attached accelerators, either in the form of smart network interface cards or as In-Network Processing accelerators.

Both application scenarios require a high-throughput hardware network stack. In this work, we integrate such a stack into the open-source TaPaSCo framework and implement a library of easy-to-use design primitives for network functionality in modern HDLs. To further facilitate the development of network-attached FPGA accelerators, the library is complemented by a handy simulation framework.

In our evaluation, we demonstrate that the integrated and extended stack can operate at or close to the theoretical maximum, both for the stack itself as well as an network-attached machine learning inference appliance.

Back to H2RC: Seventh International Workshop on Heterogeneous High-Performance Reconfigurable Computing Archive Listing

Back to Full Workshop Archive Listing