GPU

How to install GPU drivers to run LLMs

Nvidia

vim.tiny /etc/apt/sources.list

make sure this is present at the end

contrib non-free non-free-firmware

apt update
apt install -y nvidia-driver linux-image-amd64 grub-pc nvidia-cuda-toolkit nvtop

Then reboot