Build Your Own ChatGPT with LocalGPT!
Ғылым және технология
Build your own ChatGPT-like marvel within the confines of your local machine! LocalGPT is your ticket to running a Large Language Model (LLM) architecture without needing internet connectivity, granting you a fortress of data privacy. We'll install LocalGPT and use the model as is. From there, we'll ingest our own data. Then, we'll look at a simple reference app along with its API, offering an easy pathway to integrating LLMs into your unique applications. And voila, you'll be poised to do AI-based work locally. Your journey towards mastering local AI wonder begins here, and the sky's the limit!
00:00 -- Introduction
01:20 -- ChatGPT, or What to Expect
02:35 -- Cloning the Repo and Install Dependencies
04:48 -- Preforming a First Run
05:34 -- Run a Query
08:18 -- Ingest Your Own Data
10:20 -- Query Your Own Data
13:00 -- Using the Reference App
17:50 -- Calling the API with Postman
22:18 -- Conclusion
LocalGPT: github.com/PromtEngineer/loca...
Finetuning GPT-3.5 With Azure's Open AI Service: • Finetuning GPT-3.5 Wit...
How LLMs Work: • Demystifying Generativ...
Different Ways to Use ChatGPT: • 10 Ways to Use ChatGPT...
Azure OpenAI Services: • Azure OpenAI Services:...
---------------------------------
Blaize’s Website: www.blaize.net
Blaize’s Twitter: / theonemule
Music: "Chill Ambient" by Coma-Media pixabay.com/music/upbeat-chil...
Пікірлер: 6
Thanks for making these!
@BlaizeTech
8 ай бұрын
My pleasure!
Very informative, thanks for putting these.. Is there a way to finetune the local chat gpt model?
@BlaizeTech
7 ай бұрын
I don't think localGPT supports fine tuning (yet) but you can use something like Lit-GPT, which does support it. Each of these projects (GPT4All, PrivateGPT, LocalGPT, Lit-GPT) are all similar, but have different features. I like localGPT for its simplicity.
How to make the model respond in a language other than English? he understands other languages but I couldn't get him to answer in a language other than English .. (
@BlaizeTech
5 ай бұрын
It depends on the model. A model trained that going to work with more than one language takes a lot more space and GPU to work well...