Ep 11. Don't Use LangChain (yet)
Ғылым және технология
Building your first applications with LLMs is daunting because you need to interface with many data sources and build prompt workflows.
So you’re wondering, “should I start with a development framework like LangChain?” For most teams, the answer is … NO ... not now.
These products are supported by great engineers and top-tier venture funds. But unfortunately they are just too early for most development teams.
Building an abstraction layer on a new technology stack is extremely hard because there are no standards.
The foundational models like GPT-4 are changing constantly, and there are no agreed-upon best practices for building solutions.
It will take years for these standards to emerge, and until then the abstraction layers like LangChain will be in constant flux.
If you don’t believe me, spend some time on Reddit and you’ll see some strong opinions.
What should you do? Here are our suggestions.
1️⃣ Ignore the army of marketers hyping frameworks based on simple demos.
2️⃣ Instead of building applications based on these frameworks, review the open source code for inspiration.
3️⃣ Learn from the thought leaders at these products. We’ve found the content from the LlamaIndex team to be especially useful.
Ultimately, every team soon realizes that building your own interfaces isn’t that hard and ultimately elects to do so.
Good Luck!
PROLEGO NEWSLETTER
Pretend it's 1997 💾 and click here to join our email newsletter (we're making email newsletters cool again): hubs.ly/Q02d4wXQ0
PROLEGO GITHUB REPO
Yep, you can download and run locally the code 🧑 💻 that we feature in our videos. If you have questions about installation, just ask us on our Discord channel: hubs.ly/Q02d4xdp0.
ABOUT PROLEGO
Prolego is an elite consulting team of AI engineers, strategists, and creative professionals guiding the world’s largest companies through the AI transformation. Founded in 2017 by technology veterans Kevin Dewalt and Russ Rands, Prolego has helped dozens of Fortune 1000 companies develop AI strategies, transform their workforce, and build state-of-the-art AI solutions. Get in touch at hello@prolego.com.
Пікірлер: 11
Loving your content. The vast majority of the other vids are quick demo tutorials without any depth or insight. I really appreciate what you are sharing. It is helping me go beyond the surface.
@prolegoinc
9 ай бұрын
Thanks a bunch! That’s our goal. We really appreciate the feedback.
I just crashed into a wall 😂 building a demo with langchain it was so expensive and still using open ai in background. That why I came across this video, my search was “langchain is not profitable “ and you are the first explaining why. Thanks, I’m loving your videos.
Really appreciate your content, so happy I came across it. As someone who's been working in this rapidly evolving field starting my own consulting firm in RAG, I agree 100% with this. It's been so tedious to have to go back to production codebases I've developed to modify the interfaces to llama index in particular. These libraries are in constant flux. Writing your own interface is really not too difficult and allows you to customize to your particular use case. I'd listen to this guy; based on all his other content too, he really knows what he's talking about.
@prolegoinc
5 ай бұрын
Thanks for the nice note! We're working on a video of LLM RAG optimization techniques along with metrics (simple ablation study). Should be up on the 28th.
What a wonderful channel! Production ready ideas for LLMs ❤
@prolegoinc
8 ай бұрын
Thank you. We try to stay practical ...
Great quick informative vid!!!
@prolegoinc
9 ай бұрын
Glad you liked it. Have you tried any LLM frameworks?
@prolegoinc
9 ай бұрын
Glad you liked it. Have you tried any LLM frameworks?
You are right. With the new OpenAI 1106 release, one can build agents, talk to documents, all by calling its native APIs and it's much cheaper and faster as well. There seems to be no reason to continue using langchain.