Ask HN: How to Version Control Embeddings?
https://news.ycombinator.com/item?id=41409781I want to rapidly iterate generated embeddings. ChromaDB has collections so I can create a new collection for every iteration/version/commit but in my application I need to a) easily query the latest version of embeddings preferably without having to change the collection name string manually every time b) still be able to manually select a version (for A/B test) and c) quickly rollback embeddings. How do I achieve this?
One way I can imagine doing it is through feature flags but i'm not sure. Suggestions?