You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Windows-only version of ComfyUI which uses AMD's official ROCm and PyTorch libraries to get better performance with AMD GPUs. [auto-installation and popular performance enhancing packages like triton * sage-attention * flash-attention * bitsandbytes included ]
Quantized attention for AMD RX 9070 / 9070 XT (RDNA4, gfx1201): a hand-written HIP attention kernel behind SageAttention, serving the fused q/k/v views video models send, at 0.87-0.94x PR #368's time over production sizes.
Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.
AWQ/W4A16 quantization, benchmarking and public release of Polish LLMs (PLLuM, Bielik) on AMD RDNA 4 (ROCm + vLLM-native) — reproducible methodology and hardware-envelope studies.
Reproducible Docker + LiteLLM stack for running Qwen 3.6 27B with MTP on AMD RDNA4 (gfx1201). Verified on Radeon AI PRO R9700 32 GB. Built from llama.cpp PR #22673.
Qwen3.8-27B EXL3 on AMD gfx1201: RX 9070 XT (16 GB, tested) and Radeon AI PRO R9700 (32 GB). vLLM plugin with custom kernels: ~80 tok/s with MTP speculative decoding, int8 KV cache, 32k-64k context on 16 GB (up to 262k on 32 GB), vision and tool calls.
Field notes from running LLMs on AMD Radeon AI PRO R9700 (RDNA4): engines, backends, multi-GPU, speculative decoding, power, model qualification, and every mistake along the way.