Ollama: How To Create Custom Models From HuggingFace ( GGUF )
Ғылым және технология
In this video, I am demonstrating how you can create a custom models locally using the model from Huggingface with Ollama. By the end of the video, you will be able to create a simple ChatGPT like UI locally in your computer. It has never been so easy to create custom models and run it locally. Ollama and Huggingface Rocks 😎
👉🏼 Links:
Chainlit: docs.chainlit.io/get-started/...
LangChain: www.langchain.com/
Ollama: ollama.ai/
Huggingface model: huggingface.co/TheBloke/Capyb...
💻 GitHub repo for code: github.com/sudarshan-koirala/...
------------------------------------------------------------------------------------------
☕ Buy me a Coffee: ko-fi.com/datasciencebasics
✌️Patreon: / datasciencebasics
------------------------------------------------------------------------------------------
🔗 🎥 Other videos you might find helpful:
🔥 Databricks playlist: • 30 Days Of DataBricks
⛓️ Langflow: • ⛓️ langflow | UI For 🦜...
⛓️ Flowise: • Flowise | UI For 🦜️🔗 L...
🔥Chainlit playlist: • Chainlit
🦜️🔗 LangChain playlist: • LangChain
🦙 LlamaIndex Playlist: • LlamaIndex
------------------------------------------------------------------------------------------
🤝 Connect with me:
📺 KZread: www.youtube.com/@datascienceb...
👔 LinkedIn: / sudarshan-koirala
🐦 Twitter: / mesudarshan
🔉Medium: / sudarshan-koirala
💼 Consulting: topmate.io/sudarshan_koirala
#langchain #chainlit #ollama #capybarahermes #chatui #chatgpt #datasciencebasics
Пікірлер: 30
Hey mate, very good video with clear explanation. Do u mind to share what terminal app you are using? seems like very convenient with all that autocompletion and some hints
@datasciencebasics
3 ай бұрын
I am using Warp but you can watch this video for making terminal better HOW To Make Your Mac Terminal Amazing kzread.info/dash/bejne/q5eV0riQhs-faLA.html
gguf can be run directly with ollama, how to convert other formats to be converted to use with ollama ?
Excellent tutorial !!
@datasciencebasics
3 ай бұрын
Glad you liked it!
Good explanation! Is there a list of model architectures that are supported by Ollama?
@datasciencebasics
3 ай бұрын
I don’t think there is any architecture for Ollama, you can download any models and use with Ollama. Give a try !!
Thanks for sharing it, could you please create a video where we can do Q&A with local documents using Ollma models
@SantK1208
3 ай бұрын
Kindly do it , it’s really needed
@datasciencebasics
3 ай бұрын
Please check other videos in this channel, here u go -> Chat With Documents Using ChainLit, LangChain, Ollama & Mistral 🧠 kzread.info/dash/bejne/ZH2AkrWdY9HLh8Y.html
How can I edit the Modelfile, so that it includes within it a context, a personality, or a precise way of answering questions?
It would be interesting to see if you could Open-webUI instead of "Chat UI using ChainLit, LangChain, Ollama and Gemma"
Could you please use llama index with hugging face
Nice video, Can you make a video changing the system-prompt, temperature If its possible. Thankyou
@datasciencebasics
3 ай бұрын
Its possible, just provide those parameters in Modelfile.
Phenomenal
Is there any way we can use Exl2 on Ollama?
how do i pimp my chainlit logo to mine to change it please
how to create the Modefile on windows?
@AnudeepKolluri
Ай бұрын
Just open vscode and create a file called Modelfile (not sure about capitalization) and insert the content into it. It doesnt need any extension
good, how to create the Modefile on windows?😁
@datasciencebasics
2 ай бұрын
it should work in the same way, hive a try !!
hello sir can we deploy this model
@datasciencebasics
3 ай бұрын
Yes you can !!
@adhyanmishra0197
3 ай бұрын
@@datasciencebasics Sir if possible please can u create one tutorial for deploying this model
@datasciencebasics
3 ай бұрын
hello, deploying a model is use case specific. It can be deployed locally, in different cloud services , etc. Please refer to other videos in my channel for help.
Far more hassle than it's worth. Just use any other app that uses normal GGUF files, like normal people.
@datasciencebasics
22 күн бұрын
Thanks for the comment. There are many ways to do and its just a preference which one to use🙂
Excellent tutorial !!
@datasciencebasics
3 ай бұрын
Thanks !!