yujian

i've used this repo, it's a great starter pack

It's super interesting to be able to see the data in the web

tl;dr - less work = less pollution = less likely old people dying

Zilliz (zilliz.com) | Hybrid/ONSITE (SF, NYC) | Full-time

I am part of the hiring team for DevRel

NYC - https://boards.greenhouse.io/zilliz/jobs/4307910005

SF - https://boards.greenhouse.io/zilliz/jobs/4317590005

Zilliz is the company behind Milvus (https://github.com/milvus-io/milvus), the most starred vector database on GitHub. Milvus is a distributed vector database that shines in 1B+ vector use cases. Examples include autonomous driving, e-commerce, and drug discovery. (and, of course, RAG)

We are also hiring for other roles that I am not personally involved in the hiring process for such as product managers, software engineers, and recruiters.

oh yeah this is a great question, I get this a lot when I do my talks about RAG stuff

the way I see it is if you have a small amount of data (<10,000 vectors) then it's all the same and you should stick with the technology you are most familiar with

once you get more than that, you may want to consider a vector database

the reason that vector databases exist is because vector search is a highly compute intensive task, in regular database settings, you almost never have to run compute, the database is primarily looking to do an exact match

however, because vector search is predicated on the idea of finding similar vectors, and because exact vector matches are unlikely, you find yourself in the situation of having to optimize that

if you're building on a sql/nosql database you find yourself having to manage indexing, computing distance metrics, and load balancing

pgvector manages much of that for you, but due to the structure of SQL, it doesn't manage it in a very efficient manner - because it wasn't built to, an extra system needs to be built on top

as many experienced software engineers will tell you, adding complexity doesn't necessarily make something better, and adds more points of failure

purpose built vector databases like the ones in the article (eg milvus, chroma, weaviate) are built with this compute challenge in mind, and this becomes useful as the amount of data you have expands

Hi everyone, I put together this survey of tools for the LLM Stack in 2024. I've linked the friend-link for the Medium article in the URL. I'd love feedback from you guys about any tools I've missed.

If you're a Medium member and want to support my writing, feel free to use the regular link - https://medium.com/plain-simple-software/the-llm-app-stack-2...

Zilliz is hiring! We're looking for REMOTE and/or HYBRID roles in SF

Zilliz is the company behind Milvus (https://github.com/milvus-io/milvus), the most widely adopted vector database. Vector databases are a crucial piece of any technology stack looking to take advantage of unstructured data. Most recently and notably, Retrieval Augmented Generation (RAG). For RAG, vector databases like Milvus are used as the tool to inject customized data. In other words, vector databases make things like customized chat bots, personalized product recommendations, and more possible.

We are hiring for Developer Advocates, Senior+ Level Engineers and Product people, and Talent Acquisition. Check out all the roles here: https://zilliz.com/careers

Good on them, I know the crustaceans are out here happy about this raise for a Rust based Vector DB!

(now I'm gonna plug what I work on)

If you're interested in a more scalable vector database written in Go, check out Milvus (https://github.com/milvus-io/milvus)

missed the chance to call this "CeLLVM"

very nostalgic

I'm not sure if I'm missing something from the paper, but are multi-billion parameter models getting called "small" language models now? And when did this paradigm shift happen?

i'm also on dnd all day, i just don't wanna be disturbed

Anyscale consistently posts great projects. Very cool to see the cost comparison and quality comparison. Not surprising to see that OSS is less expensive, but also rated as slightly lower quality than gpt-3.5-turbo.

I do wonder, is there some bias in quality measures? Using GPT 4 to evaluate GPT 4's output? https://www.linkedin.com/feed/update/urn:li:activity:7103398...

this

Who's focusing on top 10 recall? I recently saw someone ask if we (I work at Zilliz) can update Milvus' recall to 10 million nearest neighbors lol

Zilliz | Developer Advocate, Solutions Architect | ONSITE | Full Time

Zilliz is a fast-growing startup developing the industry’s leading vector database company for enterprise-grade AI. Founded by the engineers behind Milvus, the world’s most popular open-source vector database, the company builds next-generation database technologies to help organizations quickly create AI applications. On a mission to democratize AI, Zilliz is committed to simplifying data management for AI applications and making vector databases accessible to every organization.

Developer Advocate - https://app.careerpuck.com/job-board/zilliz/job/4031246005

Solutions Architect - https://app.careerpuck.com/job-board/zilliz/job/4256138005

Interesting graphic, bland and unvoiced conclusion

You're also missing a lot of details. For example, Milvus and Zilliz are actually a little different, check this out for more details: https://github.com/zilliztech/VectorDBBench (of course run it on your own stuff, don't blindly trust companies just because their product is open source)

Also if you want to throw some more comparisons in their checkout elastic search

I work on Milvus at Zilliz and we encounter people working on LLM companies or frameworks often, I don't ask this question a lot a lot, but it looks like at the moment many companies don't have a real moat, they are just building as fast as they can and using talent/execution/funding as their moat

I've also heard some companies that build the LLMs say that those LLMs are their moat, the time, money, and research that goes into them is high

Great conceptual explanation of the different primitives in LangChain. Some possible inspiration for your upcoming piece involving vector stores with LangChain - https://milvus.io/blog/conversational-memory-in-langchain.md

Nice, this is a cool version of ANN search. I like that at the end there is commentary on what's needed for production as well - things like parallelization, RAM considerations, and the consideration for balancing the trees. It's really the production level considerations that would steer you toward a vector database like Milvus/Zilliz

I post on LinkedIn and Twitter ¯\_(ツ)_/¯

https://www.youtube.com/watch?v=y6120QOlsfU

I run community events for tech interest communities (AICamp, MLOps Community)

It's work related, but not directly

Outside of that, I don't really have much of a community. I sometimes go to local meetup groups for fun. However, I feel like these are usually a waste of time ¯\_(ツ)_/¯

coding is not a career, it's just part of the work that you do in a career

how big is your full time team?

i like to move around, sometimes i stand, sometimes i sit in the kitchen, sometimes i sit in the office on an office chair, sometimes i sit on the balcony

Looks interesting, I haven't seen sBERT yet - thanks Paul!

you suck it up for a few projects until you can establish yourself as a tech or product leader and then you can tell other people what to do, but you'll (probably) never have a point in your life where other people aren't going to at least try to tell you what to do

Same, don't really understand why there is a need for the .zip domain, but I also don't know why I can't just make any suffix a domain suffix

I think this narrative is just being sold before .zip is a new domain, I find it interesting how fast things are leveraged for hacking though, I'm wondering why this isn't as commonly noted in the AI space (where I work)