Which GPU for the job.
Prices checked
The cheapest of 4 jobs today is to generate 1,000 images, at $0.32 on RTX A5000 · Community Cloud from RunPod, checked .
Every job
all rankings148 machines
Cheapest GPU to fine-tune a 7B model
Needs 24 GB of GPU memory or more on a single board. From $0.96 per run on RTX A5000 · Community Cloud.
107 machines
Cheapest GPU to run a 70B model
Needs 80 GB on one board, or GPUs adding up to 160 GB. From $1.19 per hour served on A100 PCIe · Community Cloud.
162 machines
Cheapest GPU to generate 1,000 images
Needs 16 GB of GPU memory or more. From $0.32 per 1,000 images on RTX A5000 · Community Cloud.
70 machines
Cheapest GPU node to train for a week
Needs two GPUs or more, each with 40 GB or more. From $366 per week on 2x NVIDIA A6000.
How we count
Four things people rent a GPU to do, each priced in the units of the work rather than by the hour, from 10 providers read every 3 days. A faster board at twice the rate can still be the cheaper way to buy the job, which only shows once the page knows what the job is.
Every assumption behind a number is stated once, in "How we count" on its own page.