Ask HN: AWS g6 instances loading into VRAM slowly?

https://news.ycombinator.com/item?id=40460794
by teaearlgraycold • 2 years ago
3 0 2 years ago

I'm curious if anyone here would know what the bottleneck is when loading data into VRAM from CPU RAM on AWS. Myself and my teammates are seeing surprisingly slow load times for models. Our local training hardware doesn't have this issue. Would GCP be faster?

Related Stories

Loading related stories...

Source preview

news.ycombinator.com