AMD ZenDNN 5.0.1 Released To Help With EPYC Inferencing For Recommender Systems & LLMs
Released last year shortly after the EPYC 9005 "Turin" processor launch was ZenDNN 5.0 for Zen 5 optimized CPU inferencing with the likes of PyTorch and TensorFlow. ZenDNN 5.0 delivers up to a 400% performance uplift according to AMD engineers. Out today is ZenDNN 5.0.1 with further optimizations, particularly around recommendation engines and large language models (LLMs)...
Released last year shortly after the EPYC 9005 "Turin" processor launch was ZenDNN 5.0 for Zen 5 optimized CPU inferencing with the likes of PyTorch and TensorFlow. ZenDNN 5.0 delivers up to a 400% performance uplift according to AMD engineers. Out today is ZenDNN 5.0.1 with further optimizations, particularly around recommendation engines and large language models (LLMs)...