Beta: This SDK is supported for production use cases, but we do expect future releases to have some interface changes; see Interface stability. We are keen to hear feedback from you on these SDKs.

MacOS 11 and Windows ROCm wheels are unavailable for 0.2.21+. This is due to build issues with llama.cpp that are not yet resolved. ROCm builds for AMD GPUs: https ...