AI
-
Fine-Tuning a Qwen model on AMD Radeon AI PRO R9700 (RDNA4) using LlamaFactory
This documents the end-to-end process of fine-tuning Qwen3 models (0.6B and 1.7B) using LlamaFactory running on AMD Radeon AI PRO R9700 GPUs (gfx1201/RDNA4). For the purpose of
-
Dual AMD R9700 Setup on ASUS X99-E WS/USB 3.1
Running two AMD Radeon AI PRO R9700 cards (gfx1201, RDNA4, 32GB each) on an ageing ASUS X99-E WS/USB 3.1 board is possible, but the platform fights you at
-
Layer Split Model Parallelism on Hybrid AMD NVIDIA AI Servers using Vulkan and Llama CPP
Running a single large language model across GPUs from two different vendors is not something the tooling expects you to do. CUDA is NVIDIA only. ROCm is AMD only. The
-
How to Reduce NVIDIA GPU Power Usage and Clock Speeds for AI Inference with a Dockerised Controller
Running multiple GPUs for local AI inference at stock power settings is wasteful. Consumer cards like the RTX 3090 draw 350W by default, but AI inference workloads are typically memory-bandwidth
-
How to cool passive NVIDIA GPUs (Tesla V100, P40) with a Dockerised Fan Controller
The NVIDIA Tesla V100 and Tesla P40 are passively cooled cards, designed for data centre chassis with high-volume front-to-back airflow. Used in a desktop workstation or a home server they