Informer: Time series Transformer - EXPLAINED!

Let's talk about a time series transformer: Informer.
ABOUT ME
⭕ Subscribe: kzread.info...
📚 Medium Blog: / dataemporium
💻 Github: github.com/ajhalthor
👔 LinkedIn: / ajay-halthor-477974bb
RESOURCES
[1] Main paper that introduced the Informer: arxiv.org/pdf/2012.07436
PLAYLISTS FROM MY CHANNEL
⭕ Deep Learning 101: • Deep Learning 101
⭕ Natural Language Processing 101: • Natural Language Proce...
⭕ Reinforcement Learning 101: • Reinforcement Learning...
Natural Language Processing 101: • Natural Language Proce...
⭕ Transformers from Scratch: • Natural Language Proce...
⭕ ChatGPT Playlist: • ChatGPT
MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: imp.i384100.net/MathML
📕 Calculus: imp.i384100.net/Calculus
📕 Statistics for Data Science: imp.i384100.net/AdvancedStati...
📕 Bayesian Statistics: imp.i384100.net/BayesianStati...
📕 Linear Algebra: imp.i384100.net/LinearAlgebra
📕 Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
📕 Python for Everybody: imp.i384100.net/python
📕 MLOps Course: imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): imp.i384100.net/NLP
📕 Machine Learning in Production: imp.i384100.net/MLProduction
📕 Data Science Specialization: imp.i384100.net/DataScience
📕 Tensorflow: imp.i384100.net/Tensorflow

Пікірлер: 30

  • @_mazin
    @_mazinАй бұрын

    Thank you for explaining papers related to time-series. Would love to see your videos more on time series!!

  • @CodeEmporium

    @CodeEmporium

    Ай бұрын

    Coming up soon

  • @rpraver1
    @rpraver1Ай бұрын

    As always, great video, looking forward to next video on the code...

  • @tripathi26
    @tripathi26Ай бұрын

    This is interesting. Eagerly looking forward to next episodes ❤

  • @amiralioghli8622
    @amiralioghli8622Ай бұрын

    It is a subject I have been waiting for. Super, sir! Finally, you directed us to it.

  • @CodeEmporium

    @CodeEmporium

    Ай бұрын

    Yep!

  • @abinav92
    @abinav92Ай бұрын

    Good video! Well explained. In real life though a particular time series will correlate with itself and depend on other time series. Any way to take this into account to improve predictions?

  • @adelAKAdude
    @adelAKAdudeАй бұрын

    Beautiful ! I think the answers are: D, B, D And I'll do more research cuz I don't understand how the network is able to adjust the output according to the input Thank you sir

  • @CodeEmporium

    @CodeEmporium

    Ай бұрын

    Ding ding ding. You got full points in quiz time! And yea ~ glad this sparked more curiosity in you for further research

  • @kkdavuluri1

    @kkdavuluri1

    Ай бұрын

    @@CodeEmporium Got only one correct. The last one learning and computational complexity :)

  • @Mraclaws
    @MraclawsАй бұрын

    The video I was just looking for

  • @CodeEmporium

    @CodeEmporium

    Ай бұрын

    Super glad! Thanks for watching

  • @didulathavishasamaraweera9536
    @didulathavishasamaraweera9536Ай бұрын

  • @jorgesanabria6484
    @jorgesanabria6484Ай бұрын

    Would historical nutritional data count?

  • @shivampradhan6101
    @shivampradhan6101Ай бұрын

    so it means it makes the process faster by prob sparse attention , distillation and generative inference but does it improve the accuracy also ?

  • @CodeEmporium

    @CodeEmporium

    Ай бұрын

    According to the “experiments” section of the paper, it certainly looks like this architecture has the best performance compared to some models (including different transformer architectures)

  • @tobiaspucher9597
    @tobiaspucher9597Ай бұрын

    studies, fitness, trading

  • @VadimChes
    @VadimChesАй бұрын

    Ok. It's all interesting. But how can I use it when time-series data are received in real-time? I can not batch process, only one by one. I tried to make some kind of buffering to collect several items and then process them all together. But I didn't succeed in this, because I couldn't incorporate it in common libraries used for neural networks

  • @CodeEmporium

    @CodeEmporium

    Ай бұрын

    during real time inference, the model will typically be deployed as a part of a service. we get a request, pass this as a "batch size 1", get an output, and return the response.

  • @razok6067
    @razok6067Ай бұрын

    How can someone get in Touch with you ?

  • @hackie321
    @hackie321Ай бұрын

    Can you please blow up the Llama/Llama 2 architecture and code for us? Eagerly waiting for your LLM videos.

  • @CodeEmporium

    @CodeEmporium

    Ай бұрын

    Yep! That’s definitely a future playlist idea

  • @hackie321

    @hackie321

    Ай бұрын

    @@CodeEmporium Awesome. Thanks

  • @anilboppanna
    @anilboppannaАй бұрын

    I am just thinking about it you just made it..hope you are not reading my mind😄

  • @CodeEmporium

    @CodeEmporium

    Ай бұрын

    I just might be :)

  • @neetpride5919
    @neetpride5919Ай бұрын

    Honestly I can't think of any context where I use historical data to inform my decisions other than financial.

  • @CodeEmporium

    @CodeEmporium

    Ай бұрын

    Yea. Finance does seem like the bigger and obvious one to me too

  • @tobiaspucher9597
    @tobiaspucher9597Ай бұрын

    Answer: D ?

  • @CodeEmporium

    @CodeEmporium

    Ай бұрын

    For quiz 1, yes - it was all of them :)

  • @footsteps_destinations
    @footsteps_destinationsАй бұрын

    Provide answers to your quizzes at the end. It's really irritating to see questions unanswered. How would someone verify it. Also, please stop saying "Quiz time"