Txtai – A Strong Alternative to ChromaDB and LangChain for Vector Search and RAG

https://medium.com/neuml/vector-search-rag-landscape-a-review-with-txtai-a7f37ad0e187

by dmezzetti • 2 years ago

12 1 2 years ago

medium.com

westurner• 2 years ago

https://news.ycombinator.com/item?id=40115099 :

lancedb/lance is faster than pandas with dtype_backend="arrow" and has a vector index

From https://github.com/lancedb/lance :

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow,
[...] Vector Search
Comparison of different data formats in each stage of ML development cycle: Lance, Parquet & ORC, JSON & XML, TFRecord, Database, Warehouse

What can ChromaDB do that lancedb can't, and will either work in WASM?

From https://github.com/chroma-core/chroma :

By default, Chroma uses Sentence Transformers to embed for you but you can also use OpenAI embeddings, Cohere (multilingual) embeddings, or your own.

Txtai – A Strong Alternative to ChromaDB and LangChain for Vector Search and RAG

Related Stories