Knowledge graphs using Ollama and Embeddings to answer and visualizing queries

https://github.com/punnerud/Local_Knowledge_Graph

by punnerud • 2 years ago

122 9 2 years ago

You should probably have a requirements.txt file instead of just a list of requirements. It's often hard to tell which combination of package versions will 'actually' work when running these things

punnerud4• 2 years ago

Forgot that. Fixed now

Patrick_Devine2• 2 years ago

If you don't want to make direct API calls, there are actual official Ollama python bindings[1]. Cool project though!

[1] https://github.com/ollama/ollama-python

punnerud4• 2 years ago

Nice, thanks for the feedback. I have a prototype of also using the embeddings for categorizing the steps, with "tags/labels". Almost take it as a challenge to be able to reason better with a smaller modell than those >70B that you can not run on your own laptop.

homarp• 2 years ago

Can you use https://github.com/abetlen/llama-cpp-python or you need something ollama provide ?

speaking of embeddings, you saw https://jina.ai/news/jina-embeddings-v3-a-frontier-multiling... ?

Patrick_Devine2• 2 years ago

I actually built something similar to this a couple days ago for finding duplicate bugs in our gh repo. Some differences:

* I used json to store the blobs in sqlite instead of converting it to byte form (I think they're roughly equivalent in the end?) * For the distances calculations I use `numpy.linalg.norm(a-b)` to subtract the two vectors and then take the normal * `ollama.embed()` and `ollama.generate()` will cut down on the requests code

gunalx• 2 years ago

Is does this utilize the knowledge graph features or is it just for tracking.

punnerud4• 2 years ago

I have a new version that utilize the graph. Not pushed it yet. Then I use the embeddings to tag the answers and use tags + graph to try to understand if it is a good or bad reasoning. Hope to have it out next week.

A bit to many bugs now.

Knowledge graphs using Ollama and Embeddings to answer and visualizing queries

Related Stories