RAG with LangChain v0.1 and RAG Evaluation with RAGAS (RAG ASessment) v0.1
GPT-4 Summary: Join us for an enlightening KZread event that delves into the critical art of evaluating and improving production Large Language Model (LLM) applications. With the rise of open-source evaluation tools like RAG Assessment (RAGAS) and built-in tools in LLM Ops platforms such as LangSmith, we're uncovering how to quantitatively measure and enhance the accuracy of LLM outputs. Discover how Metrics-Driven Development (MDD) can systematically refine your applications, leveraging the latest advancements in Retrieval Augmented Generation (RAG) to ensure outputs are factually grounded. We'll start with creating a RAG system using LangChain v0.1.0, assess its performance with RAGAS, and explore how to boost retrieval metrics for better results. Don't miss this deep dive into overcoming the challenges and understanding the limitations of current AI evaluation methods, with insights from our partners at LangChain and RAGAS. This is your opportunity to learn how to build and fine-tune RAG systems for your LLM applications effectively!
Special thanks to LangChain and RAGAS for partnering with us on this event!
Event page: lu.ma/theartofrag
Have a question for a speaker? Drop them here:
app.sli.do/event/2rLa8RML994Y...
Speakers:
Dr. Greg, Co-Founder & CEO
/ greglough. .
The Wiz, Co-Founder & CTO
/ csalexiuk
Join our community to start building, shipping, and sharing with us today!
/ discord
Apply for our new AI Engineering Bootcamp on Maven today!
bit.ly/aie1
How'd we do? Share your feedback and suggestions for future events.
forms.gle/ryzhbvxZtbvQ4BCv5
Пікірлер: 36
Google Colab Notebook:
I am using llamaindex and tried some example code but it doesn't work. Is Ragas integrated with llamaindex? Ragas seems very promising for evaluation and would really like to use it. The error I am getting is in the from ragas.llama_index import evaluate, it cannot find the ragas.llamaindex. I gave up for the time being assuming that Ragas is not integrated with llamaindex?
Can we use ragas without openai key
Does ragas work only on openai model, which model i can use for testset genrator as critic and generative model please help me out
Hello. It is great job. Yesterday code was working. Today it gives error in line "response = retrieval_chain.invoke({"input": "What are the major changes in v0.1.0?"})". Can you tell me how fix this one?
Just curious how was the test having improvements in Faithfulness but a degradation of Correctness? Could u perhaps help me understand how that might be?
how can i perform batch wise ragas evaluation so that my evaluation time will decrease?
Great presentation as always guys! Small note: those of us in the hearing-impaired community are very grateful to folks like Jithin who invest in a decent mic setup. People with normal hearing generally don't see a lot of difference between a macbook mic and a dedicated one, but when your hearing is marginal it can make the difference between intelligible speech and mush that's hard for us to process. Thanks!
He , how can I generate test set (and ground truth ) With open source LLM. I'm using Mixtal. Please assist
Super nice. Thank you folks! Would be good to also discuss a bit more about the eval data: size, distribution, and how closely should it mimic real data, etc, but awesome stuff nevertheless 🎉
These material help us understand better before our class. I am glad I found you guys
Great tool and commitment to serving GenAI Dev community needs ... Thks to all involved
RAGAS starts at time
You guys are the best when it comes to intricacies of working with LLM. You presentation are simple and your explanations are cool and very simple to understand
Thank you for the video:)
Great presentation
Thanks for the video. It was really helpful . I was looking for a how we can automate the rag evaluation process .
thank you sooo much I Learned a lot from this channel. I did my experiments and I was wondering how can I evaluate the RAG performance ..
Hi