RAG with a Neo4j Knowledge Graph: How it Works and How to Set It Up
Ғылым және технология
In this video, Philipp Brunenberg explains how RAG (retrieval augmented generation) with a Neo4j Knowledge Graph works and how we can set it up on your laptop. He’ll also give a brief introduction on how we can customize the code from the Gen-AI Stack.
We’ll cover:
What is RAG?
How does RAG with a Neo4j Knowledge Graph work?
What are the benefits of using RAG & Neo4j?
How can I set up RAG with Neo4j using a Llama2 model and the GenAI Stack?
Links:
GenAI Walkthrough: neo4j.com/developer-blog/gena...
Neo4j & GenAI: neo4j.com/generativeai/
Github Repo: github.com/docker/genai-stack
RAG Blogs: neo4j.com/developer-blog/tagg...
LLM Blogs: neo4j.com/developer-blog/tagg...
@philippbrunenberg www.philipp-brunenberg.de/
00:00 Introduction
00:29 What is RAG?
02:09 The Neo4j Vector Store
03:03 Augmenting LLM answers with RAG
04:50 Using the GenAI-Stack
06:37 GenAI-Stack Configuration
08:08 The compose file
09:47 Loading data into Neo4j
11:59 Using the chat frontend
15:30 Conclusion
#neo4j #graphdatabase #knowledgegraph #langchain #genai #rag #ollama
Пікірлер: 44
Thank you for publishing this type of content. This is absolutely amazing!
Great whirlwind tour to present a concrete understading of RAG with knowledge graphs in Neo4j. Thanks. Looking forward to exploring this channel more to learn more about RAG/KGs/GenAIStack etc.
@neo4j
3 ай бұрын
Thank you very much!
This was really useful., also the presentor did an amazing job. But it was too short. I wish to see a longer more tutorial like version of it too. Or to have links to relevant knowledge and tutorials.
@neo4j
4 ай бұрын
Thank you very much! we have some more in-depth material on our blog. Check the links in the video description
Loved this video and the pace!
@neo4j
5 ай бұрын
Thank you very much!
Thanks for this robust example.
@neo4j
4 ай бұрын
Thank you!
Thank you for the deep explanation
@neo4j
5 ай бұрын
Thank you!
It is still not clear whether at the final stage what input do you provide to LLM to get the final question: - Original Question text - Text extracted from the KG nodes/edges - SO, you do not provide text associated with the best K answers resulted form initial generation of embeddings from the user prompt? ...and how to you compose the text extracted from the nodes? What is the technique?
Excellent video. Thank you.
@neo4j
3 ай бұрын
Thank you!
About how long can we expect the StackOverflow loader to import using the settings in the video to run?
Brilliant, thank you!
@neo4j
5 ай бұрын
Thanks! Glad you like it
It would be really useful to do this video adding how to convert the unstructured data to KG and the use it on a RAG. Step by step it's what makes people use Neo4j more. Thank you!
@neo4j
Ай бұрын
Thank you for the suggestion!
Thanks for sharing the video @neo4j. By the way, both responses provided in the video were inaccurate. Why wasn't the correct answer generated? 🤔
@neo4j
3 ай бұрын
sorry - can you share the timestamp where you think the answers were wrong?
Great video! What would be the minimum recommended system specs for this to work?
@neo4j
5 ай бұрын
Thank you! Any relatively modern laptop should work to give it a go and do a test-run.
Thank you so much
@neo4j
5 ай бұрын
Glad it is helpful!
Thank you ❤
@neo4j
5 ай бұрын
You're welcome! Glad it is helpful
How does this compare to what MS is doing in the GraphRAG paper, it seems like MS was really jazzed on using the LLM, GPT4, (in some way it wasn't clear) to create the relationships, the edges/weights etc, and this was the secret sauce, I assume this is different from what Neo4j is doing, but could you expand?
@neo4j
5 күн бұрын
this was a bit before GraphRAG become a term - check out the latest episodes from GoingMeta ( neo4j.com/video/going-meta-a-series-on-graphs-semantics-and-knowledge/ ) where go into GraphRAG a bit more as well
Is there any loader ready to insert own data (csv or else - not pdf) instead of stackOverflow?
@neo4j
3 ай бұрын
not as such, but the repo is available and you can modify the loader to take on other data: github.com/docker/genai-stack
Great video, I have Windows and ollama is not for windows yet. Can I run the docker under wsl2?
@nbbhaskar3294
2 ай бұрын
I have wsl2 docker setup in my windows and I am able to run ollama successfully.
This is only demo of some commercial product? Can I use it within company to build some service?
@neo4j
5 ай бұрын
the stack is based on open-source components which you can use to build your own product/servcice
How can I load PDF, markdown, into Neo4j?
@neo4j
Ай бұрын
not directly, see this community post for a few pointers: community.neo4j.com/t/loading-pdf-or-doc-content-into-neo4j/8967 this doesnt cover AI assisted tools which you can use these days for similar results
Amazing! Planning on integrating this with my neo4j db which has 1 billion relationships, might be pushing the limits a bit 🤣🤣
@neo4j
4 ай бұрын
let us know how it goes :)
@samreenkhan4994
2 ай бұрын
did it work ?
@D1zZit
2 ай бұрын
@@samreenkhan4994 Querying and using RAG on the database itself worked. Generating embeddings with FAST-RP did not despite the powerful specs of hardware. Instead had to generate embeddings on a condensed data form with many missing properties. Still working it out.
Hi! It is possible to use an own neo4j graph?
@neo4j
2 ай бұрын
yeah, totally - check out our recent Going Meta Episodes ( neo4j.com/video/going-meta-a-series-on-graphs-semantics-and-knowledge/ ) or our Courses on GraphAcademy ( graphacademy.neo4j.com/ )
@samreenkhan4994
2 ай бұрын
did u try? if yes, then how