Having done all three over my career (local machines as student, University's HPC cluster as grad/postgrad and eventually cloud in the private sector), I'd 100% rent out compute. Buying a custom rig for local ML training makes zero sense in 2026. With renting you'll be able to train bigger models/datasets faster on much better hardware while paying far less in total. Especially if you're doing project-based work.
If you use a custom disk image too, you can have it boot, apply security updates, reboot, then ssh in within minutes.
Work for however long, shut down. I do this with linode and their GPU VMs. If you shutdown nightly and on weekends, the costs drop dramatically on a monthly spend.
I only need it a few hours per day, so very cheap for custom compute.
Oh, you're just talking about deleting it when you're not using it in general, rather than during peak times. Makes sense.
[−]newComputerWhoT · 2026-11-15 Sun 19:12 UTC ·
link
The usage pattern i've seen on flexible compute is more aligned with 'I need this process to execute, run it when it's cheap' not 'I'm going to kick off this process, stop it if it get's expensive.' for example AWS Spot Instances
I mean, there are lots of reasons why you'd want something local, but I agree that the cost makes it unreasonable right now.
[−]probably_wrong · 2026-11-15 Sun 12:13 UTC ·
link
Friends of mine wanted to buy a GPU server last year for their new project. Management told them no, that there was a deal with cloud providers and that investing the budget in cloud compute was better.
The project ran out of budget roughly three months in. From what I heard, status meetings consist of everyone getting together once a month, asking "have we gotten any more budget yet? no?", and then wait until the project runs out.
Cloud providers need to make a profit too, and they've gotten very good at ensuring that their clients forget this point. The whole advantage of cloud compute is that you don't pay for the time you're not using it, but once you reach a certain point you're the one covering the overhead for everybody else.
Work for however long, shut down. I do this with linode and their GPU VMs. If you shutdown nightly and on weekends, the costs drop dramatically on a monthly spend.
I only need it a few hours per day, so very cheap for custom compute.
The custom volume keeps your persistent install, configs, work in progress, etc.
You can programmatically kick off a linode, attach the volume, then boot, as well as delete, all via curl or python.
So not variable rates, but no rates when the beast is deleted.
The project ran out of budget roughly three months in. From what I heard, status meetings consist of everyone getting together once a month, asking "have we gotten any more budget yet? no?", and then wait until the project runs out.
Cloud providers need to make a profit too, and they've gotten very good at ensuring that their clients forget this point. The whole advantage of cloud compute is that you don't pay for the time you're not using it, but once you reach a certain point you're the one covering the overhead for everybody else.