HN user
Founder @ Latitude.sh here. We own the servers and the network. 25+ years operating infrastructure and now as part of Megaport (who acquired us last year) we’ve got ton of experience in infra and network
Feel free to ping me guilherme at latitude dot sh
That's all included, you don't have to add the bare metal servers, networking or anything else.
Latitude.sh provides the L40S, not L40
The on demand cost is $9.30/hr and $4,752/mo when paid a year upfront
I am sorry if you are finding our pricing page confusing. We had a recent update to that page and we had a glitch for prices for the GPUs. Anyway, the correct price for a 8 x L40S is $4752/mo when paid a year upfront.
Adding another provider with availability for the H100 here, https://www.latitude.sh/accelerate/pricing
Instances from 1 to 8 x H100 GPUs, paid by the hour
As you were CPU limited on LambdaLabs, have you tried GPU instances from Latitude.sh? https://www.latitude.sh/accelerate/pricing
Each H100 is paired with 32 3.25GHz CPUs