ONNX and ONNX Runtime
Ғылым және технология
What is the universal inference engine for neural networks?
Tensorflow? PyTorch? Keras? There are many popular frameworks out there for working with Deep Learning and ML models, each with their pros and cons for practical usability for product development and/or research. Once you decide what to use and train a model, now you need to figure out how to deploy it onto your platform and architecture of choice. Cloud? Windows? Linux? IOT? Performance sensitive? How about GPU acceleration? With a landscape of 1,000,001 different combinations for deploying a trained model from some chosen framework into a performant production environment for prediction, we can benefit from some standardization.
See more at www.microsoft.com/en-us/resea...
Пікірлер: 17
Really awesome presentation skills, simply precise and clear.
very informative talk!
Nice work.
Thanks for the video! I am interested in adding a new custom operator to onnxruntime in C++, but there isn't any example for it. Does anyone know of one?
Can I train it on Pytorch in Python and run the model in in Java, Javascript, C++, and more? I am talking about RNN, Transformer, fastRCNN, and more advance model.
@areebmuzaffarsyed859
3 жыл бұрын
yes
I cant get mlmodel to onnx converter to work on mac
OMG, please show the slides more than the presenter. I can never finish reading most of the slides because they are shown for only a few seconds. This is very, very, very annoying and disappointing.
Too short a time showing slides. Constantly need to backup & pause to digest slides.
Good presentation badly edited, the ratio of presenter footage to slides is awful. Some slides are barely on the screen for a second.
@prudvi01
2 жыл бұрын
makes a good podcast tho
@briancase6180
2 жыл бұрын
I was screaming at the screen after about half way. Very annoying!
Pranav Sharma bhai, please bring toilets to us in India
@kikirizki4318
4 жыл бұрын
But we should build deep learning model first and make it learn how to make a toilet
@indahpratiwi4308
4 жыл бұрын
@@kikirizki4318 benar!
@kikirizki4318
4 жыл бұрын
@@indahpratiwi4308 why do you know I am an Indonesian?