Thanks for sharing, awesome effort! Tinkering a lot with how to wrap my large datasets with KGs, so food for thought... Is it possible to tell what was causing that latency to answer the questions? Was it only GPT-4? Also, would be great to see the token usage straight away, show some prompts, and discuss the learnings by model (what worked well and where) - this would be super interesting. Cheers!

I have been waiting for it a tool like this for a while. I wish you could emphasize the process of ingesting structured data from public databases. Especially to ingest triples. There's plenty of data offered by the European Union which is not very accessible. Also having a way to ingest unstructured data with predefined constraints by using ontologies would be particularly useful. I have no idea how to implement that though.

@neo4j

Ай бұрын

good point! maybe that will be possible with an update

Great video and great app! I have a question on how the llm is used to generate responses based on the knowledge graph. From my understanding, whether i'm using langchain or llamaindex cypher chatbot, the chatbot basically receives the prompt as well as the list of all existing nodes and relationships and from that it generates a cypher query to retrieve the relevant context from the knowledge graph to then formulate the response. But the list of all nodes and relationships will get longer for every new document being added in the graph, so since the llm is limited by its context window, isn't this approach unscalable? if so do you guys any solution to this problem? thanks in advance.

@PierreRibardiere

3 күн бұрын

PS: This situation is probably only relevant to when an LLM is used to extract entities and relationships without restriction on node/relationship types. So you could get large amount of different nodes and relationships. But sometimes you can't know in advance what type of entities/relationships you want to extract from a set of documents so you let the llm extract anything it can. Hmm how do you deal with the limited context window problem?

I wanted to use public app. When trying to connect I get following error: Could not use APOC procedures. Please ensure the APOC plugin is installed in Neo4j and that 'apoc.meta.data()' is allowed in Neo4j configuration

The repository is not working. The demo is very neat though.

@neo4j

Ай бұрын

strange - so I can reach the repo here: github.com/neo4j-labs/llm-graph-builder If you want to try out the app right away you need to go to: llm-graph-builder.neo4jlabs.com/

@thanartchamnanyantarakij9950

Ай бұрын

@@neo4j Is diffbot is the only way to extract entities, relations, properties? Can I use opensource llm like llama3?

@morgansenechal1434

Ай бұрын

@@thanartchamnanyantarakij9950 Hi, yes but you would have to implement the integration with the llm you want to use. In the application we demoed and linked above, we currently have Diffbot, OpenAI (GPT 3.5 and GPT 4) and Gemini (1.0 pro and 1.5 pro), you can check out how we've done the implementation as everything is opensource and take inspiration from it for making the integration with the llm you want to use

wow...unfortunately after that initial wow, I'm disappointed because I could not run the app.

@neo4j

29 күн бұрын

sorry to hear that - what is the problem?

@alexanderroodt5052

28 күн бұрын

@@neo4j It fails at "/bin/sh -c yarn add @neo4j-nvl/interaction-handlers @neo4j-nvl/core @neo4j-nvl/react""

Trying to link my basic knowledge from kzread.info/dash/bejne/mKigvJKolbu_gqg.html with this video. Trying to build my first RAG with Neo4j Hope to do it this weekend. The main goal of companies right now is to have a better answer from a RAG without hallucinations. Hope with neo4j we achieve it. UPDATE: Playing already with the workspace. It would be nice to have a RAG like on the video, with a chat UI integrated on a webpage, or similar. From the begining till the end. Creation of the Database, feed it, Graph creation and finally having the Chatmodel ask the Graph database.

@morgansenechal1434

Ай бұрын

Hi @tecnopadre , thanks for testing it out already! You do have the full flow from beginning till the end within this application, I presented the chatbot in a different screen but you have the same chatbot integration in the app, on the main screen, click on the bottom right button: "Q&A Chat" and that will open the RAG Chatbot, plugged on your KG that you just created and will be able to answer your questions on the data you just loaded.