How Transformers Js Can Help You Create Smarter AI In Your Browser
In this video, I'll introduce you to WebML and TransformerJS, which is all about using AI in the browser. We'll explore a library called transformers.js that allows us to use the hugging faces transformers Python library in JavaScript. I'll show you how to perform tasks like natural language processing, computer vision, and even multimodal tasks directly in your browser without needing a server. We'll also dive into examples of using WebML in vanilla.js, React, and Next. So let's get started!
📰 FREE eBooks & News: sendfox.com/nerdingio
👉🏻 Course: www.udemy.com/course/ai-in-th...
📞 Book a Call: calendar.app.google/M1iU6X2x1...
🎥 Chapters
00:00 Introduction to WebML
01:02 Chrome Extension Example
04:18 Behind the Scenes of WebML
06:44 Defining Pre-trained Models
07:20 Convert Pre-trained Models
08:22 Demos
09:00 React Translator
10:54 Blind Chat
11:41 Code Gen
13:00 Review
🔗 Links
huggingface.co/docs/transform...
github.com/nerding-io/questio...
huggingface.co/collections/Xe...
huggingface.co/spaces/Xenova/...
huggingface.co/spaces/mithril...
⤵️ Let's Connect
everefficient.ai
nerding.io
/ nerding_io
/ jdfiscus
/ ever-efficient-ai
Пікірлер: 4
wow, thats nice!!
My biggest gripe with this library is that something about the model conversion is not well documented. I’ve tried converting and using several types of models for supported tasks and they always give me a problem in some way when I try to load them.
@nerding_io
5 ай бұрын
I’ve had some issue too and it took some digging. However I posted a GitHub issue and it was resolved quickly. Plus it was fun to dig. What were you converting? Maybe I can make a video on the conversion process.
@MaxM9000
5 ай бұрын
@@nerding_ioI've tried a small range of models including BERT (for the pooled embeddings), Flan-T5 (for conditional-text generation & LangchainJS), and Whisper (for automatic speech recognition on NodeJS, Electron, & React/ReactNative). None of these projects have actually been successfully completed past trying to load the models. My main method of conversion is via the optimum-cli conversion command. Transformers JS also has their own script but I'd have to download their repo. The Transformers JS conversion script also adds quantization but I just need the models converted. Also, I've used the conversion script and even then I cant get the models working. A video going over both methods and showing them working would be great help to people who want to convert their models for mobile/web/local applications.