AMD has released an update to Ryzen AI Software 1.6.1, adding initial support for Linux. Previously, the package was only available for Windows. Currently, Ubuntu24.04LTS is officially supported.
The update allows the use of Ryzen AI NPUs for CNN (INT8/BF16), NLP (BF16) and large language models (LLM) models, while at least 64GB of RAM (minimum 32GB) is required for comfortable operation of LLM. Access to Linux binaries is currently limited to registered AMD customers, making it difficult to use and test on Linux.
/Reports, release notes, official announcements.