LibShalom: Optimizing Small and Irregular-Shaped Matrix Multiplications on ARMv8 Multi-Cores
Event Type
Paper
Algorithms
Architectures
Numerical Algorithms
TP
TimeThursday, 18 November 202111:30am - 12pm CST
Location220-221
DescriptionGeneral matrix multiplication (GEMM) is a key subroutine in high-performance computing. While the existing BLAS libraries can obtain near peak hardware performance on large GEMM, they deliver low performance on small and irregularly-shaped GEMM. We propose and implement an algorithm for small and irregularly-shaped GEMM, which can effectively reduce the overhead of packing operation. In addition, we also propose a novel parallelization method to tap the computing potential of multi-core CPUs. Our work achieves high hardware utilization through a series of optimizations. Our experiments show that on ARMv8-based processors, LibShalom can achieve about a 1.05x - 3x performance speedup over mainstream BLAS libraries, including OpenBLAS, ARMPL, BLIS, LIBXSMM and BALSFEO.
Download PDF
Archive view