Ask HN: What OS/distro is used at an AI datacenter

https://news.ycombinator.com/item?id=43977006
by kranke155 • 1 year ago
2 2 1 year ago

I am making a film where we see a "desktop" screen of someone working on an AI data centre. They are deploying a new AI model.

I'm a tad confused about this - because I don't know what OS / Linux distro is used at a AI data centre level.

I'd like this to be authentic, but I can't find a lot of information about what is used.

Main question:

I am assuming at the data centre level, one would use Linux? Is that correct?

More questions:

1. So - what about CUDA on Linux? Does CUDA run really well on linux, or do they somehow run the models autonomously from the OS layer when they are running these huge AI models?

2. So if they're deploying a new model, do they use the linux terminal or something else, some sort of nvidia terminal layer, or even custom tools?

3. Is there a preferred distro for an AI data centre, or is this the case that each AI lab makes their own distro or chooses their own?

4. Also, should I assume is this is CLI only, or would they have a distro that has a GUI?

I couldn't easily find answers to these questions, I hope it's ok to ask these on HN here.

This would be a video/multimodal model. The company is a fictional version of Youtube.

Related Stories

Loading related stories...

Source preview

news.ycombinator.com