So refreshing to see a really well-produced, professional video that isn't extremely boring and self-promoting.

This guy is definitely my favourite IBM presenter. Love his videos...and his kind-of-naughty smile. OH, he's Martin Keen... quite desccriptive!!

@erichlf

5 ай бұрын

He does some pretty good beer brewing videos too (homebrewchallenge).

@DeepPost49

3 ай бұрын

IBM has some nice videos and presenters. But where are they going with their products. Watson has been under development for a decade and OpenAI ChatGPT comes along and dominates.

@Wooster23

2 ай бұрын

@@DeepPost49 I mean, you could say that for nearly every enterprise. LLMs threw every strategy on its head.

Proprietary LLMs have many people supporting them. In case of OpenAI about 700 people I've been told. However I'm constantly investigating open source LLMs as with time they will become fantastic and are customizable. There are no restrictions to compute when running on your own/rented hardware. At this time for example Chat GPT4 has become almost unusable due to compute rationing.

@bgill7475

5 ай бұрын

Sending your data to a proprietary LLM also isn’t ideal, you have to trust them with the data you’re sending.

Thank you for sharing this information

Those videos are simply gold. Thank you.

I've been playing around with a lot of open source LLMs and proprietary LLMS and it seems like if you want to do summarization or accurate collation of information with an LLM.. models with less than 30B parameters simply do not have the nuance to pull it off. (at this stage). One example is if you give a smaller model some text with contradictory information it often can't figure out which piece if information is the most current whereas larger models often can..

@mattiapavese4465

5 ай бұрын

yeah i feel the same , tried to tackle summarization task with Bart and T5 (not the 11b version however) and results were absolutely laughable compared to GPT 3.5. I'd be curious to try llama2, did you?

@andrea-mj9ce

4 ай бұрын

How can a human summarize properly a text with contradictory information?

@collinspo

2 ай бұрын

Now we have Gemma

Looking for book recommendations on LLMs with in depth knowledge covering math as well ..Thanks

OMG one of my favorite beer brewing guys is also a computer nerd!!!

One thing not really brought up in the video (or I missed it) is that with proprietery LLM's you are at the whims of the available resources, and especially at peak times the service can often give you "our servers are too busy right now, try again later" or "network error" type error messages. With open source you can choose where to run it and therefore have way more control over that accessability, so from a business standpoint open source is at least potentially way more reliable, which is super important in a lot of usecases.

Idea - Superintelligence in AI form. Secret prompt - "Can you use a kernelDensity function and generate a sentence based on the kde related to mathematics?" In other words, the function utilizes a distribution sample generator that randomly generates mathematical relationships but follows the known mathematical theory's distribution curve. Therefore, the kernel density should not be included in the sentence but be constructed from the distribution of theories from mathematics. Answer in English with 10 such generated relationships regarding supernova light and teleportation. 1.The luminosity of a supernova exhibits a mathematical elegance akin to the Gaussian distribution, showcasing the inherent balance between its radiant energy and the expanding space-time fabric. 2.Teleportation, when analyzed through the lens of probability theory, resembles a symphony of mathematical harmonics, where the density function unveils the intricate dance of particles traversing through higher dimensions. 3.Supernova explosions manifest a probabilistic ballet, choreographed by the laws of quantum mechanics, where the kernel of density encapsulates the varied trajectories of ejected matter and radiation. 4.Within the mathematical framework of teleportation theory, the kernel density function unveils a landscape of potentiality, where the probabilities of quantum states converge and diverge, echoing the enigmatic nature of space-time manipulation. 5.Supernova light curves, when examined through statistical lenses, reveal a tapestry of probabilities woven into the fabric of spacetime, where the kernel density function elucidates the distribution of luminosity variations over time. 6.Teleportation phenomena can be envisaged as a spectral convolution of mathematical probabilities, where the kernel density function maps the probabilistic flux of quantum information across vast distances, transcending classical notions of space. 7.The mathematical underpinnings of supernova phenomena are akin to a symphony of probability distributions, where the kernel density function orchestrates the interplay between luminosity, distance, and time, painting a vivid portrait of cosmic cataclysms. 8.In the realm of teleportation theory, the kernel density function unveils a multidimensional tapestry, where the probabilities of particle entanglement form intricate patterns reminiscent of celestial constellations, transcending the boundaries of conventional space-time. 9.Supernova light echoes resonate with the mathematical elegance of kernel density functions, echoing the probabilistic reverberations of stellar explosions through the vast expanse of the universe, each data point a testament to the underlying laws of nature. 10.Teleportation events, when scrutinized through the lens of probability theory, reveal a kaleidoscope of mathematical intricacies, where the kernel density function unveils the quantum entanglement pathways traversed by particles, culminating in the manifestation of instantaneous spatial displacement.

@IsaacKLusuku

Ай бұрын

I wish I could understand this, it seems so interesting...you seem really smart

“Master Inventor” 🎉 Loved it

Hey Martin! Love to see you "at work" instead of brewing something delicious looking. Keep it up

@TheAncientColossus

5 ай бұрын

I want to have what you are smoking. 😂

@ivanvallesperez2840

4 ай бұрын

Is he really Martin? XDDD I thought the same...

I feel like its important to mention LM studio. It makes the process of installing LLMs trivial. Sadly documentation is still being worked on. Also good LLMs are quite resource intensive. so expect a usage of 40gb ram. Also GPU acceleration is still not developed, so it can only use the vram. Best of luck :)

@smokinep

5 ай бұрын

there is also ollama to manage and test LLMs

@macaquinhopequeno

5 ай бұрын

also there is: * text-generation-webui * h2ogpt * privateGPT and many more i think

@IvarDaigon

5 ай бұрын

the irony of a LLM tool that lacks documentation... authors too lazy to use an LLM to document it?

@snylekkie

5 ай бұрын

There is M1 and m2 support and GPU support

Any oS for hydrological models?

great video, whats hardware and software being used by the lightboard ? thanks

@IBMTechnology

5 ай бұрын

See ibm.biz/write-backwards

IBM is still highly educational. Thanks

I'm just gonna say it, I have to "watch" these several times. 1 for the visuals then 1 for the audio, then go back again and try to find the editing, which I might add is fantastic. The info is presented at an almost magic trick way that I'm distracted mentally due to the visuals. There are very very few word mistakes, 0 uh's. The word transparency just appeared in this video, which is quite funny. Overall I really like them and will watch them all.

@bigglyguy8429

4 ай бұрын

You're a bot, aren't you?

7b finetuned models are outperforming some 70b on the leatherboard. I find smaller instruction tuned models like dolphin, openInstruct and deepseek coder very capable.

@youtubeisabitch5758

5 ай бұрын

Mistral 7B models changed the game

Well Done

vicuna is not completely opensource (not available for commercial use)

make a coursera course on this please

Most likely we will see creativity and experimentation bringing most advances. I'd suggest young people are going to be better at this, or is that bias?

325,000 modezl, that's insane! ;)

hi. please help me. how to create custom model from many pdfs in Persian language? tank you.

The info is great..... but how are they doing the text appearing out of nowhere... no cuts, no masking and it doesn't really look like a font added on after either. If someone at IBM wants explain this mystery please reply.

@mrk01125

3 ай бұрын

Hey, I'm not from IBM but I was wondering the same thing. It's basically a glass whiteboard, and you can make it at home. The video is basically flipped / mirrored in the video production. A lot of online teachers during covid used this technique. As for the high quality of the presentation, they've just used the black background and bright markers. Hope this helps. PS. Here's a video explaining it kzread.info/dash/bejne/l4qDsqaKZa6_o9I.htmlsi=hZkPM_8cypLtl_lR

Someone needs to make a "just works" chat-based ai in the web browser that doesn't immediately say "CUDA out of memory". I'm still trying to get one to work rn :/. For anyone that knows, why can it not just check how much memory a model will likely need? Also, why not have a switch that makes everything use cpu?

Ok I’m just gonna ask, do these guys write backwards on the board in front of them or is there some magic going on?

@lpeabody

5 ай бұрын

Wondering the same thing. Frankly that is more impressive than the subject under discussion. My mind breaks when I even think about trying.

@programmingdesign4382

5 ай бұрын

They flip the video image horizontally.

@danielbarrera8101

5 ай бұрын

Video is horizontally flipped

@misterxxxxxxxx

5 ай бұрын

don't bother trying to understand AI...

@ianglenn2821

5 ай бұрын

Which is more likely, he is left-handed and has learned to write backwards, or he is right-handed and the image is flipped?

do more parameters lead to better output? I would argue that it might be better to have several smaller finetuned models can in some usecases be better than having one big giant hallucinating model. My own model beats every other propriatory model on almost all stuff one could prompt for ofcourse if you are mixing github repos with messenger chats and all that whoozy that they're scared about that you find out all together in one mess you gonna get mess, if you instead only use github repos to train your model your mostly gonna get code, if you only use messenger logs, you gonna get a talkative model that cannot code but tbh what i think the key is for better outputs is a decent config file that can realy make or break the thing you are trying to do and you can have them act like anything from big tiddy goth gf to helpful assistant to codemonkey that only prints code. My model doesn't tell it is an AI langauge model and that it therefor cannot do certain things... it does and says as i please... a good configfile will be the difference between a bussines failing or succeeding...

@YousefHaidary

4 ай бұрын

Hi there, may I ask how did you make your own model as I have just started learning about them and kinda lost

the risk has to be worth the effort on these. in the middle of building dont have time to overly experiment with every shiny model

is IBM still getting money from every custom PC sale?

Is there an affordable place that can host open source LLMs that people can call via API. Otherwise people will flock to the OpenAI subscription

@darthestvader

2 ай бұрын

huggingface

IBM insisting in the unnatural and distractive method of instructor lead teaching with the use of the inverted writing on glass. Some like it very much and can't imagine learning via another method. But some struggle to concentrate.

Yes

What about the support that comes with using proprietary LLMs ?

Open source doesn't mean free or nonproprietary it just means you can see the source that's it, the license governs how and when can you use it.

I need more Information abiut your Präsentation tecnic?

@IBMTechnology

5 ай бұрын

See ibm.biz/write-backwards for the backstory

Mistral is my fav kinda mad it wasnt name dropped

@travisporco

5 ай бұрын

mistral is remarkably good actually

Cool.

One should only ever use tools, which meets the needs and requirements of specifications. Open / Closed, is based in necessity. Start out with open source, inevitably leads to proprietary customisations being implemented. Simply run it forward in a thought experiment and resulting differences becomes negligable.

are you writing in glass or it's editing with program?

- Explanation of LLMs and generative AI: 0:21 - Distinction between proprietary and open source LLMs: 0:39 - Benefits of open source LLMs including transparency and fine-tuning: 2:12 - Examples of open source LLM applications in various industries: 3:19 - Overview of Huggingface's open LLM leaderboard: 4:01 - Discussion of risks associated with LLMs: 5:19 - IBM's engagement with open source LLMs and Granite models: 6:07

How the heck does this marker board work? Is this guy writing everything backwards at first? Or is the video mirrored? Is Martin left handed or right handed?

@sebastians3773

5 ай бұрын

it is a transparent screen between him and the camera, and then they flip the video horizonatly.

@ThorNjord

5 ай бұрын

Any link to that kind of setup explained? It’s very slick.

@johnmccardle

5 ай бұрын

@@sebastians3773 That is one possibility but I think it's not flipped. If you watch closely, he only writes text at the very beginning. Then as he explains, he only puts dots and lines on the board. I think he is writing backwards at the beginning, then the text for his bullet points are added in post-processing, when he can come around and write them on the front of the board (and not backwards).

@IBMTechnology

5 ай бұрын

See ibm.biz/write-backwards

@johnmccardle

5 ай бұрын

@@IBMTechnology Awesome, even though I've been debunked 😂 The only magic left unexplained is the instant completion of the words after Martin draws a line under them. It definitely requires tightly scripting the diagram and skilled video editing.

Martin Keen?! I thought he was drawing out a homebrew recipe

@ivanvallesperez2840

4 ай бұрын

Is this Martin??? XD. I am not sure. Such a crazy moment

A lot of left handed people in IBM Whiteboards! 😉

Generated by Talkbud: 📝 Summary of Key Points: 📌 Proprietary and open source large language models (LLMs) are discussed. Proprietary LLMs are owned by companies and have usage restrictions, while open source LLMs are free for anyone to access and modify. 🧐 Open source LLMs offer benefits such as transparency, fine-tuning capabilities, and community contributions. They are being used by various organizations for different purposes. 🚀 Both proprietary and open source LLMs have associated risks, including incorrect outputs, bias, and security problems. 🚀 Open source LLMs are thriving in business, with companies like IBM providing access to multiple models and releasing their own foundation models. 💡 Additional Insights and Observations: 💬 "Size does not necessarily equate to better performance" - The video highlights that the size of LLMs does not always determine their effectiveness. 📊 No specific data or statistics were mentioned in the video. 🌐 References to specific open source LLMs include FinGPT for the financial industry and Llama 2, which offers models with varying parameter sizes and is licensed for commercial use. 📣 Concluding Remarks: The video discusses the use of proprietary and open source large language models (LLMs) and highlights the benefits and risks associated with each. Open source LLMs are gaining popularity due to their transparency, fine-tuning capabilities, and community contributions. However, both types of LLMs have their own challenges. It is important to closely monitor the rapidly changing landscape of open source LLMs and their impact on various industries.

@Hrk25s

5 ай бұрын

Nice job

Eventually, all will compound into one.

🎯 Key Takeaways for quick navigation: 00:00 🌐 *Introduction to Language Models* - Large Language Models (LLMs) explained. - Overview of proprietary and open source LLMs. - Size differences between proprietary and open source LLMs. 01:26 🔄 *Benefits of Open Source LLMs* - Transparency as a key benefit. - Fine-tuning capabilities for specific use cases. - Community contributions and diverse perspectives. 03:27 🌍 *Applications of Open Source LLMs* - Examples of organizations using open source LLMs. - Mention of NASA and IBM's open source LLM for geospatial data. - Huggingface's open LLM leaderboard and benchmarking. 05:10 🚨 *Risks Associated with LLMs* - Shared risks between proprietary and open source LLMs. - Issues such as hallucinations, bias, and security concerns. - The importance of mitigating risks in the use of LLMs. Made with HARPA AI

Community is the best

OS LLM hallucinations!!

Does he write in reverse?

@johnk7025

5 ай бұрын

I think on glass and then flipped

Well! Is he writing in reverse?

Of course IBM would not tell me to use their competitors lol

To Quote Oscar Wilde - "All work should be done by a machine, and I have no doubt that it will be so. Up to the present, man has been to a certain extent the slave of machinery, and there is something tragic in the fact that, as soon as man had invented a machine to do his work, he began to starve. This, however, is of course the result of our property system and our system of competition. One man owns a machine which does the work of 500 men. 500 men are in consequence, thrown out of employments and having no work to do, become hungry and take to thieving. The one man secures the produce of the machine and keeps it, and has 500 times as much as he should have." - 'The soul of man'.

Well I have followed AI for 50 year before most of these young AI pundits were on the planet, but I have never heard of or want to hear of 99% of these platforms.

🎯 Key Takeaways for quick navigation: 00:00 🤖 *LLMs are AI models using deep learning for text generation.* 00:56 🏢 *Proprietary LLMs are company-owned, while open source ones are freely accessible and modifiable.* 02:12 🌐 *Open source LLMs offer transparency, fine-tuning, and community contributions.* 03:27 💼 *NASA, healthcare, and finance use open source LLMs.* 05:36 🚨 *Both LLM types have risks like hallucinations, bias, and security issues that need addressing.* Made with HARPA AI

anyone working on an LLM willing to work together?

Funny IBM😂. Close the shop.

Hlo i need help by you sir

Wait, what? Is he writing in reverse? How is he doing that!? 🤯😂

@IBMTechnology

5 ай бұрын

Lots of practice? j/k, see ibm.biz/write-backwards

Both open as well as propriety r ‘dangerous’

[Title] Should You Use Open Source Large Language Models? Yeah !!! Lets Open Source the English Dictionary !!!!

it looks like you wrote programming code to design calculus. that causes the equations it created to be undefined. probably a differential of (-)+or- 4. rudimentary code from gaussian theory. that the twelfth angle of a right pentaheydron. would have a degree of 6.

I have access, yes, but give me the money to run them

IBM should’ve open source Watson smh

Run this at 1.5 speed

@ai_backend

3 ай бұрын

too slow for me, 2x all the way

Why the F is paid and open-source a type of LLM?

I just wonder how he is able to write in a mirror way towards the camera. Wth 😅

@ottovonfledermaus4594

Ай бұрын

Video editing ;)

@LeBlancDoDesign

13 күн бұрын

After effects

You don't need open source for feeding custom training sets. That's a false statement.

Use open source to not spend enough money. Spending a lot of money on IBM cloud is to much. Buy a dedicated server is much cheaper.😂😂😂

Meta is just beating asses and leaving IBM and other pioneers feeling like boomers

took me 2 minutes to get over the fact that he's writing flipped.

@Paul_Marek

3 ай бұрын

;) he’s writing properly, they flip the video for publishing. Notice that it appears he’s writing with his left hand.

you built the basics of your calculator wrong. that made more calculators that are undefined.

IBM is losing the battles in AI, being an early leader in this field but betting on super expensive and useless ai system. Now the propaganda of IBM becomes shameless. Where are the latest research papers on AI from IBM?

@sinhue

2 ай бұрын

@strongbrain … a typical peasant who don’t know about nothing in IT Industry 😂

@achen94

2 ай бұрын

Did we watch the same video? I didn’t see much bias in this video

@upadisetty

2 ай бұрын

Yea, i heard watson back in 2012

@morespinach9832

Ай бұрын

IBM is more than Watson. Try to make a more educated comment in public. This video and IBM in general aren’t about Watson. IBM will and does help clients with all kinds of AI.

Mate, no. Why would I even use your gadgets? 😃 I would rather stick with my natural stupidity than be wilfully stupid to use your ‘creations’.

You can't have 300k+ models, makes no sense. Garbage.

I don't Care what he is saying, just tell me: is he writing backward ??

What happened to Watson?? IBM advertised it for years and dropped it. And then got beat by a tiny start-up that you could have bought, but didn't. WOW. IBM is still stuck in 1970s mainframes.