Ollama: How To Create Custom Models From HuggingFace ( GGUF )

Ғылым және технология

In this video, I am demonstrating how you can create a custom models locally using the model from Huggingface with Ollama. By the end of the video, you will be able to create a simple ChatGPT like UI locally in your computer. It has never been so easy to create custom models and run it locally. Ollama and Huggingface Rocks 😎
👉🏼 Links:
Chainlit: docs.chainlit.io/get-started/...
LangChain: www.langchain.com/
Ollama: ollama.ai/
Huggingface model: huggingface.co/TheBloke/Capyb...
💻 GitHub repo for code: github.com/sudarshan-koirala/...
------------------------------------------------------------------------------------------
☕ Buy me a Coffee: ko-fi.com/datasciencebasics
✌️Patreon: / datasciencebasics
------------------------------------------------------------------------------------------
🔗 🎥 Other videos you might find helpful:
🔥 Databricks playlist: • 30 Days Of DataBricks
⛓️ Langflow: • ⛓️ langflow | UI For 🦜...
⛓️ Flowise: • Flowise | UI For 🦜️🔗 L...
🔥Chainlit playlist: • Chainlit
🦜️🔗 LangChain playlist: • LangChain
🦙 LlamaIndex Playlist: • LlamaIndex
------------------------------------------------------------------------------------------
🤝 Connect with me:
📺 KZread: www.youtube.com/@datascienceb...
👔 LinkedIn: / sudarshan-koirala
🐦 Twitter: / mesudarshan
🔉Medium: / sudarshan-koirala
💼 Consulting: topmate.io/sudarshan_koirala
#langchain #chainlit #ollama #capybarahermes #chatui #chatgpt #datasciencebasics

Пікірлер: 30

  • @amiranvarov
    @amiranvarov3 ай бұрын

    Hey mate, very good video with clear explanation. Do u mind to share what terminal app you are using? seems like very convenient with all that autocompletion and some hints

  • @datasciencebasics

    @datasciencebasics

    3 ай бұрын

    I am using Warp but you can watch this video for making terminal better HOW To Make Your Mac Terminal Amazing kzread.info/dash/bejne/q5eV0riQhs-faLA.html

  • @SIR_Studios786
    @SIR_Studios786Ай бұрын

    gguf can be run directly with ollama, how to convert other formats to be converted to use with ollama ?

  • @IamalwaysOK
    @IamalwaysOK3 ай бұрын

    Excellent tutorial !!

  • @datasciencebasics

    @datasciencebasics

    3 ай бұрын

    Glad you liked it!

  • @ScrantonStrangler19
    @ScrantonStrangler193 ай бұрын

    Good explanation! Is there a list of model architectures that are supported by Ollama?

  • @datasciencebasics

    @datasciencebasics

    3 ай бұрын

    I don’t think there is any architecture for Ollama, you can download any models and use with Ollama. Give a try !!

  • @SantK1208
    @SantK12083 ай бұрын

    Thanks for sharing it, could you please create a video where we can do Q&A with local documents using Ollma models

  • @SantK1208

    @SantK1208

    3 ай бұрын

    Kindly do it , it’s really needed

  • @datasciencebasics

    @datasciencebasics

    3 ай бұрын

    Please check other videos in this channel, here u go -> Chat With Documents Using ChainLit, LangChain, Ollama & Mistral 🧠 kzread.info/dash/bejne/ZH2AkrWdY9HLh8Y.html

  • @nataleamato3406
    @nataleamato3406Ай бұрын

    How can I edit the Modelfile, so that it includes within it a context, a personality, or a precise way of answering questions?

  • @ph3ll3r
    @ph3ll3rАй бұрын

    It would be interesting to see if you could Open-webUI instead of "Chat UI using ChainLit, LangChain, Ollama and Gemma"

  • @SantK1208
    @SantK12083 ай бұрын

    Could you please use llama index with hugging face

  • @Pedro-mq7kt
    @Pedro-mq7kt3 ай бұрын

    Nice video, Can you make a video changing the system-prompt, temperature If its possible. Thankyou

  • @datasciencebasics

    @datasciencebasics

    3 ай бұрын

    Its possible, just provide those parameters in Modelfile.

  • @aimademerich
    @aimademerich3 ай бұрын

    Phenomenal

  • @mixp1x
    @mixp1xАй бұрын

    Is there any way we can use Exl2 on Ollama?

  • @121Gamerscom
    @121Gamerscom3 ай бұрын

    how do i pimp my chainlit logo to mine to change it please

  • @terry-bn7bh
    @terry-bn7bh2 ай бұрын

    how to create the Modefile on windows?

  • @AnudeepKolluri

    @AnudeepKolluri

    Ай бұрын

    Just open vscode and create a file called Modelfile (not sure about capitalization) and insert the content into it. It doesnt need any extension

  • @terry-bn7bh
    @terry-bn7bh2 ай бұрын

    good, how to create the Modefile on windows?😁

  • @datasciencebasics

    @datasciencebasics

    2 ай бұрын

    it should work in the same way, hive a try !!

  • @adhyanmishra0197
    @adhyanmishra01973 ай бұрын

    hello sir can we deploy this model

  • @datasciencebasics

    @datasciencebasics

    3 ай бұрын

    Yes you can !!

  • @adhyanmishra0197

    @adhyanmishra0197

    3 ай бұрын

    @@datasciencebasics Sir if possible please can u create one tutorial for deploying this model

  • @datasciencebasics

    @datasciencebasics

    3 ай бұрын

    hello, deploying a model is use case specific. It can be deployed locally, in different cloud services , etc. Please refer to other videos in my channel for help.

  • @AlanCarrOnlineHypnosis
    @AlanCarrOnlineHypnosis23 күн бұрын

    Far more hassle than it's worth. Just use any other app that uses normal GGUF files, like normal people.

  • @datasciencebasics

    @datasciencebasics

    22 күн бұрын

    Thanks for the comment. There are many ways to do and its just a preference which one to use🙂

  • @BiranchiNarayanNayak
    @BiranchiNarayanNayak3 ай бұрын

    Excellent tutorial !!

  • @datasciencebasics

    @datasciencebasics

    3 ай бұрын

    Thanks !!

Келесі