What are some good AI model monitoring tools used in production?

https://news.ycombinator.com/item?id=38530591

by uma08 • 3 years ago

1 8 3 years ago

news.ycombinator.com

Are there any good tools we can use to monitor and observe AI models in production?

verdverm3• 3 years ago

In what sense? logical / input-output monitoring, or cpu/mem/net/usage metrics?

uma083• 3 years ago

CPU/GPU/, Memory, multi-cloud, model degradation

verdverm3• 3 years ago

I'd use the same things we use for all the other things we run in the cloud, nothing special about an AI model here. Probably holds true if you think about input/output monitoring too, it's going to be called through an API, and there are plenty of tools for monitoring that as well.

Ideally your cloud provider has an easy to use solution. If not, there are monitoring services you can pay for as well. Running the open source alternatives takes some expertise.

little_birdy232• 3 years ago

We found aporia to be really useful for production observability and monitoring. Fits easily with our Vertex infrastructure, but I think they can be deployed all over.

uma083• 3 years ago

What's their pricing like? They don't seem to display it on their website

little_birdy232• 3 years ago

Yeah, I think you have to reach out to them for that. Depends on your needs, I guess.

What are some good AI model monitoring tools used in production?

Related Stories