No video

Low-Rank Adaptation - LoRA explained

Пікірлер: 18

  • @gelly127
    @gelly1273 ай бұрын

    Underrated channel, keep making videos and itll eventually blow up

  • @AIBites

    @AIBites

    2 ай бұрын

    Sure. Thanks for the encouraging words 👍

  • @dileepvijayakumar2998
    @dileepvijayakumar2998Ай бұрын

    this is better explained than what the inventor of Lora itself explained in his video.

  • @mr.daniish
    @mr.daniish3 ай бұрын

    Amazing video

  • @AIBites

    @AIBites

    3 ай бұрын

    Glad you think so! 😊

  • @benkim2498
    @benkim2498Ай бұрын

    Super in depth and specific, thank you!!!

  • @talmaimon4534
    @talmaimon45345 ай бұрын

    Thanks for the video! I loved that you added some libraries we can use for this.

  • @AIBites

    @AIBites

    5 ай бұрын

    do you want me to do more videos on hands-on? Or should I continue on the theory and papers? your inputs will be quite valuable :)

  • @jacobyoung2045

    @jacobyoung2045

    5 ай бұрын

    ​@@AIBites Hands on videos will be great too

  • @unclecode
    @unclecode7 ай бұрын

    Good job on the clear explanation of the method and simplification. At 3:40, when you showed the matrix decomposition, the result on the left side does not match the result on the right side. Is this a mistake in the video editing, or is there a point to this? [1 2 3] x [2 20 30[ should be [[2. 4 6], [20 40 60], [30 60 90]]

  • @AIBites

    @AIBites

    7 ай бұрын

    ah yeah! super spot! I got that wrong while editing. Sorry... 🙂

  • @ananthvankipuram4012

    @ananthvankipuram4012

    4 ай бұрын

    @@AIBites Yup the Matrix should be [1/2/3] * [ 2 20 1]

  • @AIBites

    @AIBites

    4 ай бұрын

    Thanks again :)

  • @abdelmananabdelrahman4099
    @abdelmananabdelrahman40997 ай бұрын

    wow u r great 😄

  • @AIBites

    @AIBites

    7 ай бұрын

    Thank you! I am chuffed :)

  • @pshivaramakrishna
    @pshivaramakrishna4 ай бұрын

    Very Well Explained! If ΔW's dimensions is 10 x 10 , A and B dimensions are 10x2 and 2x10 respectively. So, instead of training 100 params we only train 40 params (10x2 + 2x10). Am I correct ?

  • @AIBites

    @AIBites

    4 ай бұрын

    yup you got it right. And based on the compute available, we can adjust the rank ranging from say from as low as 2.

  • @pshivaramakrishna

    @pshivaramakrishna

    4 ай бұрын

    @@AIBites Thanks for the confirmation.