From d8632982102ac225349f8c62235ac56de8c63531 Mon Sep 17 00:00:00 2001 From: Daniel Hiltgen Date: Wed, 20 Nov 2024 16:00:46 -0800 Subject: [PATCH] docs: Link to AMD guide on multi-GPU guidance (#7744) --- docs/troubleshooting.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/docs/troubleshooting.md b/docs/troubleshooting.md index 3400b4e84..24e8e962f 100644 --- a/docs/troubleshooting.md +++ b/docs/troubleshooting.md @@ -104,6 +104,12 @@ If you are experiencing problems getting Ollama to correctly discover or use you - `OLLAMA_DEBUG=1` During GPU discovery additional information will be reported - Check dmesg for any errors from amdgpu or kfd drivers `sudo dmesg | grep -i amdgpu` and `sudo dmesg | grep -i kfd` +## Multiple AMD GPUs + +If you experience gibberish responses when models load across multiple AMD GPUs on Linux, see the following guide. + +- https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/native_linux/mgpu.html#mgpu-known-issues-and-limitations + ## Windows Terminal Errors Older versions of Windows 10 (e.g., 21H1) are known to have a bug where the standard terminal program does not display control characters correctly. This can result in a long string of strings like `←[?25h←[?25l` being displayed, sometimes erroring with `The parameter is incorrect` To resolve this problem, please update to Win 10 22H1 or newer.