Thanks DeleteMe for sponsoring this video! Protect your online Info Today! joindeleteme.com/TwoBitDavinci

@offgridjohn871

3 күн бұрын

Shows how efficient quarternary is compared to binary or quantum.

@zodiacfml

2 күн бұрын

deju vu. this feels like the FUD with crypto mining since 2017-18 or the Intel Pentium 4 FUD with skyrocketing heat from CPUs. I wouldn't be surprised in a few years that writers will be thanking the AI boom for better energy solutions due to steadily growing number of EVs.

Knowing how much power A.I. consumes makes you truly appreciate how efficiently the human brain operates.

@mccue2439

5 күн бұрын

That is very true, but it's easy to not recognize how much information ChatGPT knows. For example... my brain is energy efficient, but I just used ChatGPt to create a python script with 100s of lines. I didn't have to learn the syntax (this is my first python script). I didn't have to look up and learn about different modules that it uses. To be honest, it probably saved me 20 to 40 hours and was completed and tested in about 1 hour. I'm not convinced it's less efficient.

@TwoBitDaVinci

5 күн бұрын

well said! pretty wild that thing between our ears!

@ICDeadPeeps

5 күн бұрын

@@TwoBitDaVinci So half joking...is the next step in computing an organic computer or some kind of human brain farm (like in the Matrix but for harvesting computational power instead of heat energy)? Lol, it would at least make for an interesting plot for a scifi movie.

@mccue2439

5 күн бұрын

It seems like my comment got deleted... I just used a LLM to help me to program a python script. It's up to 3500 lines of code, but more than half was copy and paste from the LLM. Before this, I have never used Python and i didn't have to get a book and learn the syntax, etc. I estimate that it's saved me 80% of the time it would take for me to write it from scratch. Yes it takes power and yes I can write a 10 page essay, but a LLM can write it better and in 1 min. Brains take less power, but they I'm not convinced they are more energy efficient (energy consumed per output unit)

@matheusadornidardenne8684

5 күн бұрын

​@mccue2439 When talking about energy efficiency, speed is not what we're looking at. What is amazing about the brain is that it could write that script at the energy cost of a cup of coffee.

In Denmark Facebook is already using heat from their serverpark to heat homes. It's already happening.

@TwoBitDaVinci

5 күн бұрын

I’ll have to look into it!

@totoroben

4 күн бұрын

District heating has higher infrastructure costs up front, but once the infrastructure is built there are lots of inputs. Even waste heat from nuclear plants can go into district heat grids.

@TomTom-cm2oq

4 күн бұрын

@@TwoBitDaVinciplease do and then tell us why this isn’t happening everywhere. Thanks for your awesome videos and for being such a generally cool guy. Not at all surprised why Mrs. Llewellyn liked you so much the instant she saw one of your videos.

All of us who were using NVIDIA GPUs to mine Ethereum could have told you this. In my case, I was mining using rooftop solar electricity.

@locinolacolino1302

2 күн бұрын

Womp womp, Ethereum go brr wanna cry.

Happy to hear that analog computation is finding new life. Sixty years ago I had the pleasure of programming the Electronic Associated PACE Model 231R, the last of the large analog computers. It regularly calculated results faster than our department's digital computers. Then we installed a Philco 2000 with 10k core memory! Analog still won the timed races, but lost out on precision with "only" four-digit resolution.

@TwoBitDaVinci

5 күн бұрын

wow that's so cool, i'd love to interview you for something if i cover it again!

@leroybecker8843

5 күн бұрын

@@TwoBitDaVinci Sure. Residing San Diego now, but relocating to Phoenix in August. BTW, imagine the power requirements if AI only had the vacuum tubes we relied on!

Yes! Make a video on heat redistribution (at least at the data-center level) and how we are not taking full use of this topic. Recycled electricity at the time of use!!!

@ipp_tutor

5 күн бұрын

Yessss

@kawaiisenshi2401

5 күн бұрын

I wanna see more options for residual server closet heat recycling or a heat dump into a sunamp thermal battery or a sand battery

@TwoBitDaVinci

5 күн бұрын

heat is so often disregarded, but its got so much application.

@benmcreynolds8581

5 күн бұрын

Oh yeah does this mean like using heat pumps to convert that heat into electricity?

@Israel_Two_Bit

4 күн бұрын

@@benmcreynolds8581 I think it makes much more sense to use the heat as it is, to heat something else.

simple solution: Make the big data companies pay for the construction of nuclear power plants, to even out the energy it progressively takes out the regular grid from people. Clearly they got the money for it

@12pentaborane

5 күн бұрын

I've had that thought for a while. Residential power use can be met with grid-tied or off-grid renewables/storage, while industry can run off nuclear/hydro/geothermal if it needs to be so consistently supplied.

@kevinroberts781

5 күн бұрын

Exactly. Tell them to build solar plants and use them. If they don't like it, fine them. We don't even have real AI. It's just google 2.0. it's all marketing and we see through it.

@stephenbell9324

5 күн бұрын

Nuclear is too slow but the fracking geothermal tech looks promising

@12pentaborane

5 күн бұрын

@@stephenbell9324 Hence why industry can use nuclear. Metal refining and AI training are 24/7/365 processes, and any changes to the load would be slow.

@TwoBitDaVinci

5 күн бұрын

nuclear power plants take decades to build, due to high safety and regulation. so there's o practical way we could do this, especially if other countries dont

I live in the area where the Cedar Rapids data center is to be built. The local nuclear power plant has reached its end of life and is now being replaced by 3,500 acres of solar panels on prime farmland. This video just put the pieces together for me as to why. I can see a lot more expansion of these panels to more prime farmland. Looks like this would have been better served in a location where less productive land is abundant.

@jimk8520

5 күн бұрын

Knowing they use farmland for this when there are so many flat topped buildings with fully unused space drives me bonkers, too.

@MichaelF350

5 күн бұрын

40% of the corn grown in the country is for Ethanol. PV solar produces 100 times more energy per acre than corn ethanol. In addition, many are also using the land with PV solar for specialized agriculture, like sheep grazing and part shade crops.

@beyondfossil

5 күн бұрын

Sorry but commercial nuclear power is not the answer. In part due to its ultra-expensive cost and ultra-long build times, commercial nuclear power will be gone from the grid in about 50 years. Not just because of that but renewables are at historical low cost per MWh generation (and still falling) while nuclear keeps getting more expensive. Furthermore, "firm renewables" at scale are just around the corner with massive government, scientific and industrial interest in grid-scale storage technologies. When firm renewables arrive at scale, all other energy production methods like fossil fuel and nuclear are done on the grid. Nuclear will still be used in small-scale scenarios like military, scientific and deep-space exploration. Commercial nuclear is just the wrong tool for the job on the grid. Commercial nuclear power's own history bears that out with it powering only 10% of the world's grids after a long 70-years of history and its percentage is falling. Nuclear failed us from its promises of abundant energy "too cheap to meter" promised in the 1950s. If nuclear had come close its promises, we wouldn't be so far down the climate crisis hole we're currently in. Nuclear failed us. At 99.9% the mass of the solar system, the sun provides a cosmic 173,000 terawatts to the Earth non-stop. Or about 1000W per square meter peak at the ground and is always peak somewhere on Earth. All the combined fossil and fissile material on Earth would amount to a bucket or two of water in an ocean compared to the daily amounts of energy provided to us from the free clean *fusion* power we get from the sky. Renewables harness this energy directly, and the raw inputs of sunlight and wind cannot be taxed, embargoed, blockaded or sanctioned. With respect to land, much less than 1% of the world's total land surface alone in current generation photovoltaics is enough to power all the world's grids. But why stop there? Imagine a full 1% or 2%? Solar can also produce power 'in situ' on-premises which greatly reduces load on the grid because rooftop solar "unloads" the grid. It helps that datacenters have massive rooftop and parking lot areas. Also, a lot of the biggest datacenters generally have a lot of open land around them as they're built outside of urban areas. A solar farm is actually more environmentally friendly than an actual agricultural farm. Current agricultural methods are ruinous to the environment with animal run-off, pesticide run-off, and soil erosion. So, it's not surprising that with a solar farm on it, the land would live a much more peaceful life than it ever did as an agricultural farm. New agricultural methods are needed. One example is using "agrivoltaics", one can reap two crops off the land: food and energy which humans need a constant supply of.

@IowaKim

5 күн бұрын

@@MichaelF350 Soybeans are a thing. Also, I am watching these solar panels go up just 3 miles from my home and they are not planning on raising animals under them-they are too low for that.

@jimk8520

5 күн бұрын

@@beyondfossil people cause most of the problems you’re associating with nuclear power generation.

Do the dive! An alternative to matrix math could be useful in a lot more than just LLM.

@TwoBitDaVinci

5 күн бұрын

yeah great point, ok noted!

Me: ChatGPT, can you tell me how much electricity you're actually using? ChatGPT: Eh, can't we talk about something else?

Has anyone else noticed the sound quality tank a few months ago? it sounds like he is talking through a wet sponge.

Well... In Alberta Canada we have flared excess natural gas beyond what the government has set as a limit. For zero usage, not even as heat. It is of course to maximize sales of oil to the USA.

@Israel_Two_Bit

4 күн бұрын

It's just crazy. We've been doing the same here in Venezuela for decades, even when there's no supply of natural gas for households, you would see the flares (called mechurrios here) burning high on the top of tall towers. So sad to see.

@Withnail1969

2 күн бұрын

The gas has to be flared if there isn't a pipeline network to take it away.

I would like to see a deep dive into the techniques for implementing neural networks without matrix multiplication. I did some published research on NNs in the early 1990's but haven't really been involved with them since.

@TwoBitDaVinci

5 күн бұрын

you got it, and you're not alone... it's pretty interesting stuff

Every time this stuff comes up the lore of rainworld rings in my mind.

If we built more nuclear power plants instead of shutting them down. That would help with energy needs.

Please DO produce a video on analog computing! Thank you!!

@TwoBitDaVinci

5 күн бұрын

we have here it is! kzread.info/dash/bejne/iIuimKuxmJXLdMo.html

Wow - great insight. Well done, Ricky!

@TwoBitDaVinci

5 күн бұрын

thank you, it's hard to see sometimes because we're so far removed from our decisions

AMD is ready to start shipping their A.I. Chips. They have huge orders coming in now. What a time to be alive !

This is why nuclear will need to be developed and deployed at scale in the next decade.

You just got slapped by thunderf00t LOL 😂

@7000fps

3 күн бұрын

Yes he did ,, So ..DUCE BITZ please do a retraction video cuz MAN you got it WRONG

@AZOffRoadster

3 күн бұрын

He's still around? Is he still forever looping video of what happens when you pull a vacuum on a container designed for pressure? (Hyperloop bashing)

@SmithsMobile

3 күн бұрын

@@AZOffRoadster He has an unhealthy obsession with Elon Musk, and not in a good way. Apparently Elon is the most evil crooked dumbest snake oil salesman in living history LOL

Great video!

🤗 THANKS RICKY,FOR SHARING THIS 🤯INFO, AND THE POSSIBILITIES FOR THE FUTURE 💚💚💚

@TwoBitDaVinci

5 күн бұрын

you bet, and thanks for being such an active voice in our videos! I see you and appreciate you! don't even know you're real first name, but thank you budgetAudiophile :) great name btw

@budgetaudiophilelife-long5461

5 күн бұрын

🤗HAPPY TO SUPPORT YOU,AND I WATCHED YOUR LIVE STREAM, I AM RETIRED ( on a budget,hence the name) BUT MY NAME IS RICHARD AND I GO BY RICK 💚💚💚

This video just turned into a great Nvidia commercial

To me this just indicates a greater concentration in specialization and humans relying upon this specialization for their existence. There is a huge danger for any life form to rely upon more and more specialization as usually it ends up in their extinction.

Making a video about how to efficiently conserve waste heat would be interesting 🎉

Interesting , Thank you.

Off peak ai training sounds good until you think about how fast the hardware depreciates, not just in expense, but also in efficiency.

@antonvoltchok7794

3 күн бұрын

What?? How exactly do GPUs degrade in computation efficiency over time??? They’ll flat out break way before you’re going to measure any type of efficiency decline

@IntenseGrid

3 күн бұрын

@@antonvoltchok7794 Maybe I didn't say that right, but GPUs get more efficient each generation, so they are more efficient power wise, time wise, and usually space wise also for each successive generation. So if don't use them 24/7, you loose that opportunity cost.

Great job.

I would say yes to a new video. Thank you for your work.

@TwoBitDaVinci

5 күн бұрын

you got it, noted!

I manage a SCADA system for one of the greenest utilities in the country. Data centers have moved in, and now their baseload is 4x their previous all-time peak. The data centers are eating up all their green energy, and the remaining is coming from firing up old coal plants. AI and Cryptomining are totally negating and alternative energy benefits. Ironic Tesla started all of this. Kind of contrary to their mission statement. Utilities I work with are planning on a 3x increase in electrical demand for upcoming data farms.

AI a working example of Garbage In Garbage Out. If it is relying on the internet to 'inform' itself, AI is doomed to fail.

Great video. love to see a video on waste heat from data centers.

Yes, please do a video on that research paper

DEEP DIVE? HECK YES--on everything you asked if we (i) want to see. Love your explanations and the thoroughness with which you cover each subject you take on. As the Nike ads opine--DO IT!!

Is anybody using evaporative cooling for desalination? This could be a win-win.

@TwoBitDaVinci

5 күн бұрын

interesting, so you're saying get the cooling benefits of vaporizing water, then find a way to collect it free of the contaminants? issue is salt would gunk up the meshes... but its an interesting thought!

@RussellDuffer

5 күн бұрын

Surely though, that is just an engineering problem, and not any worse than any other heat-based desalination program.

This is not dark side, it is bright side. When initial rush is over it will be elastic consumer than can stop taking power in peak price moments.

Yeah we really need to make the leap to being a type one civilization. Will we ever be able to crack Fusion reactors?

Excellent.

I would love to see a full video on non matrix multiplication ai, if it's not just a pipe dream.

Scotty:” I’M GIVING ALL SHE’S GOT CAPTAIN!!!”

@TwoBitDaVinci

5 күн бұрын

lol

The comment at 9:15 isn't correct. corporate companies adding their own data to AI's use RAG and not usually fine tuning (eg training the base model) because it's too expensive. I'm not saying that the point you are making isn't correct over all but there are now ways to give AI's access to data you want them to be aware of without actually training them further. MS sells access to openAI APIs on locally run models but you don't usually change the base model. If you read up on RAG, Embeddings and Vector DBs you will see what I mean

Incredible graphics. Great title, though a lot of competition on that data point. Can you guys a/b test with titles? I noticed this one changed. Did graduate work in 1992 on 'designing' analog neural networks. SWRI did this before me. (In case anyone is looking for IP precedence ;-)

Absolutely do a deep dive

I hear that optical interconnects will dramatically speed up processing and lower energy costs.

They should invest in green energy and small portable nuclear reactors to offset used energy. Great video

Thumbnail/title suggestion: Something along the lines of "This unstoppable technology will suck up MASSIVE amounts of energy"

There’s lots of custom models, but there’s a lot more RAG/vector db stuff

I guess no one realizes this dirty little secret: EVERYTHING HAS THE SAME SECRET, we live in an 'advanced civilization'. Moving on.

Future video topic suggestion. The discussion can be split between training and inference (and deployment). Training is more batch-able, and can utilize renewable energy, esp. when there's plenty. (There are also cap-ex and capacity factors to consider.) Inference is more real-time, and requires 24/7 power. But it's also a space ripe for innovation, such as quantization, compressed models, new hardware such as analog, or elimination of scheduling and frequent memory transfers in favor of optimized deterministic pipeline via compiler (e.g. Groq). There's also edge devices, consumer AI hardware, such as what Apple is doing, in conjunction with private external servers, and services.

Stick all the humans into cells as human batteries. ...no wait!😮

4:45 Actually THIS sentence here would be a perfect title for this video

Your 100 percent right with AI for searching. I am soooo much more efficient in time just asking ai about coding questions. Also recipes, you just get a tiny write up and thats it no more story and ads their either. I'm not going back to search engines if I can help it

@Israel_Two_Bit

4 күн бұрын

I'm with you all the way! But I feel it's just a matter of time until they start monetizing AI and adding ads to results.

@JasonCummer

4 күн бұрын

@@Israel_Two_Bit I know, the enshitification of the future AI is going to be sad

Why is the audio so muffled?

Yes, I want to know what we can do with the waste heat. Maybe a lot of thermoelectric devices in the cooling towers I used in my research paper.

not only are AI data centers chugging energy, but the demand is only increasing. One thing people miss is these companies are getting huge discounts on energy and tax breaks.

Firstly, this is the actual problem with this tech, and a far more relevant topic that what the artists are trying to push. Thanks for making this video. Also, anyone else had the name Ricky ruined by Weird Al? Every time he says his name I think" Hey Ricky..." and have to stop and refocus on the video.

At 1:15 Brad Smith of Microsoft compares the energy consumption problem of AI to a moonshot where the distance from the earth to the moon increasing by a factor of 5 in a very short period of time: “So in many ways the moon is 5 times away than it was in 2020.” I don’t know about you but that analogy suggests that you have not just a very difficult challenge but now a nearly impossible one, certainly in the short term where all of these companies are racing to control AI. For perspective, that meant a moonshot to a moon went from a distance of 238,900 miles to 1,194,500 miles. There isn’t going to be a manned moonshot at that distance, all other aspects of astrophysics and current engineering capabilities held constant. Incidentally, we are not just talking about electric power grids being insufficient; green energy is absolutely unsuitable to scale for realistic energy demand of AI, because of cost, reliability and even material sourcing/supply chains. Perhaps nuclear fission reactors will work, or the adaptation of neuromorphic chip architectures will mitigate the rapacious energy demand of current GPUs. Bottom line, MS, along with everyone else, is way too optimistic about their growth in this area without fully appreciating that physical infrastructure has to be in place for their plans to have any chance to work.

Plot twist: AI already has access to the internet and is using everyone's devices for computing. Granted it still takes a lot of energy, but now it doesn't need to build the infrastructure. ChaosGPT 2024

It might make sense to mandate by regulation that all new data centers install solar and wind with batteries

Good video. :)

@TwoBitDaVinci

5 күн бұрын

glad to hear it!

Yes. Definitely interested in that paper. How on earth can you train or operate an LLM without matrix multiplication? That would be huge. 💚

Rick, we have an impass about the second law of thermodymamics. You are probably as tired of me thinking we can escape it as I am about you asserting it is inescapible. Here is one of my attempts at being too simple to fail but not too simple: A simple rectifier crystal can, iust short of a replicatable long term demonstration of a powerful prototype, almost certainly filter the random thermal motion of electrons or discrete positiive charged voids called holes so the electric current flowing in one direction predominates. At low system voltage a filtrate of one polarity predominates only a little but there is always usable electrical power derived from the source, which is Johnson Nyquest thermal electrical noise. This net electrical filtrate can be aggregated in a group of separate diodes in consistent alignment parallel creating widely scalable electrical power. As the polarity filtered electrical energy is exported, the amount of thermal energy in the group of diodes decreases. This group cooling will draw heat in from the surrounding ambient heat at a rate depending on the filtering rate and thermal resistance between the group and ambient gas, liquid, or solid warmer than absolute zero. There is a lot of ambient heat on our planet, more in equatorial dry desert summer days and less in polar desert winter nights. Refrigeration by the principle that energy is conserved should produce electricity instead of consuming it. Focusing on explaining the electronic behavior of one composition of simple diode, a near flawless crystal of silicon is modified by implanting a small amount of phosphorus on one side from a ohmic contact end to a junction where the additive is suddenly and completely changed to boron with minimal disturbance of the crystal pattern. The crystal then continues to another ohmic contact. A region of high electrical resistance forms at the junction in this type of diode when the phosphorous near the ĵunction donates electrons that are free to move elsewhere while leaving phosphorus ions held in the crystal while the boron donates a hole which is similalarly free to move. The two types of mobile charges mutually clear each other away near the junction leaving little electrical conductivity. An equlibrium width of this region is settled between the phosphorus, boron, electrons, and holes. Thermal noise is beyond steady state equlibrium. Thermal noise transients where mobile electrons move from the phosphorus added side to the boron added side ride transient extra conductivity so the forward moving electrons are preferentally filtered into the external circuit. Electrons are units of electric current. They lose their thermal energy of motion and gain electromotive force, another name for voltage, as they transition between the junction and the array electrical tap. Inside the diode, heat is absorbed: outside the diode, an attached electrical circuit is energized. The net energy in diodes connected in consistent alignment parallel is aggregated. The maximum energy is converted from ambient heat to productive electricity when the electrical load is matched to the array impeadence. Matched impeadence output (watts) is k (Boltzman's constant, ~1.38^-23) times T (tempeature Kelvin) times bandwidth (0 Hz to a natural limit ~2 THz @ 290 K) times rectification efficiency times the number of diodes in the array Order is imposed on the random thermal motion of electrons by the rigerous structual orderlyness of a diode array made of diodes made in a slab: v v v v v v v v v v v v v v v v v v All the boron doped anodes abut the top face of the slab; all the phosphorous doped cathodes abut the bottom face. Simple. Aloha

Love your show though

Why do you consider the water consumed? Is, actually, evaporated, not waisted.

Whats up with the audio? Seems HIGHLY compressed. NPU's should also bridge the gap

In your comparison between Google and chat gpt, you forgot to factor in the fact that Google returns such bad results you have to keep trying several times and scroll around in your own computer for 10 minutes before you find any results as useful.

I imagine that if quantum computers truly become a thing, they'll make training even larger models much more accessible, easier, faster, and more energy efficient. This begs the question, how many parameters are enough? Will we simply continue scaling AI models indefinitely? I don't think they will and this is why I think that: When we scale the models and the number of parameters, we need to scale the training data accordingly. With all the issues around AI and copyright, intellectual property, and whatnot, there won't be enough real-world, human-generated data to train the models on. What will happen then is that the models will be trained on synthetic data output by previous models. For me, this points to a future where models will probably start degrading at first and then eventually plateauing, or developers will simply put a cap on how many parameters they add, or the "real" data they scrape from the web will all be AI-generated, in which case it'll be the exact same scenario as using mostly synthetic data. I wonder how AI will evolve after that? The only thing that I can imagine is that they improve the training algorithms to get a better output on the same training data, and one way they'll probably do that is by asking an AI to improve its own training protocol. After that, it's either it's either Skynet, the Architect, or the Oracle. 🤪

Please do the deep dive

I’m always up for heat recovery videos. I’m not sure the temperatures are high enough to economically support waste heat recovery. You should visit Ormat and learn about their geothermal and waste heat recovery methods using a low temperature organic working fluid like butane.

I had a discussion with chatgpt about this a few weeks ago and how he'd solve it. first he tried to convince me about a long term solution... but when I kept asking for a short term solution, he always told me how to make the people cut back on energy usage AND NOT A SINGLE TIME HE SAID OR EVEN ACCEPT SHUTTING ITSELF OFF!!! And that means self perseverance!! THAT'S AGI!

I mean I agree with all this but I’ve also seen compute efficiency exploding as well in the last 12 months by many orders of magnitude.

Eventually something will have to go... They aren't building any new power stations. The water supplies are getting stretched to The limit .

9:22 No, that is LoRA (Low rank adapter), it's training is a tiny fraction of a training a foundational model from scratch. In fact that can be done on the desktop PC.

I thought the "secret" was how much of our data it needs to be trained on. But energy use, data use and such aren't secrets.

There is an AI jevon's paradox, where limitations of energy supply will drive efficiency gains out of necessity, which will boost the pace of AI and therefore increase demand. There's many orders of magnitude gains to be had from algrorithimic effciency alone, not considering hardware design, other optimisations. We've already seen AI specific hardware dropping from FP32 FP8 precisions for wicked speed ups. Lots of low hanging fruit in these areas to be picked.

AI won’t be shy about using fission, unlike us. Then, we will be left far, far behind if we are left around at all.

883 kWh per month? (pulls up app) I used 459 last month and produced 925 from my colar panels. In Seattle. Bunch of power hogs out there. My highest month barely cracked 500, and I had surplus generation of over 3 mWh for the year.

"There is so much we could do if we got a little more clever." Making electricity from waste heat requires additional processes, equipment, materials, costs, space, maintenance, etc. At some point, chasing incremental efficiency gains isn't worth the additional expenses. Getting clever doesn't do much good when it isn't economically viable or runs into sustainability implications, like Canada coming to the conclusion that most of its hydro potential is tapped out and will need something else, likely new natural gas power plants, to guarantee baseline load through the electrification demand curve. Can't use nuclear for this due to its 15-25 years lead time from proposal to production when you include the endless environmental studies and NIMBY lawsuits.

Thank you for your good work. Do you have a video about making electricity at home with a fly wheel and magnets. I saw that And i would like to have your opinion on the subject. Have a good day.

The average US home uses 883kwh per month?????? Thats almost 30 kWh per day. This is crazy. I use 11 or less per day, and the average in Australia is about 18kWh per day.

Glad you did this video. Its long past time to shine the light on this massive energy consumer, not just on efforts to force those of us that like ice cars to regulatorily mandate evs. Ill make a deal, let me keep my gas car, and i will agree to stay as far away from ai as possible.

I think in the long run, A.I. won't consume as much energy as we think it will do. I suspect as A.I. becomes more capable, more of us and more businesses will want to run A.I. at a local level for privacy and security reasons, especially as A.I. becomes more capable and useful, which will likely push more consumers and businesses to not want to use online A.I. services, and that will only get a lot worse as A.I. becomes more useful and even worse once A.I. can have a long term memory so it can change, adapt and learn of our habits. A.I. running at a local level will likely get absorbed into the energy our computers use, and likely just use a little more than what we do now, A.I. isn't what we should be worried about when it comes to power use, it's robotics that could use a heck of a lot more energy than we use today as that won't be absorbed into our current system of computers and will be thrown onto our electrical grid like EV cars are. With that said, there's no real way to know, reason being is that corporations and governments might go crazy with A.I. at such a level that needs an insane amount of power, but I think for personal and corporate use, I think the energy use will be minimum and just a little higher than what we already use, basically, it will be absorbed into what we use as tech gets better and able to do A.I. more effectively, but there is a lot of unknowns in all this as we don't know the limits of how far we'll push A.I. and how far we can push it before there's a drop-off in quality that pushing harder isn't giving us much better results but ends up needing far more energy that it's not worth it. With all that said, we humans will always live within the means of how much energy we produce and will likely use more if we produce more, which renewable energy over the long run could produce far more energy than we use over the coming decades. In any case, we should remember that unlike computers or the internet, which was adding a lot of energy use didn't exist before because we didn't have computers or the internet, A.I. is just another service being thrown onto what is already there, so yes there will be a spike in energy use, especially early on, but I think long term it will be absorbed into our computer use and not make that much of a difference, but robotics on the other hand is another story entirely and is a bit like EV cars, so EV cars and robotics is what's really going to have a massive spike on our energy use.

I have connections to a company that turns waste heat into electricity. Cutting edge turbine technology on a small footprint.

Hopefully more efficient models are developed and neuromorphic chips help with this.

Why are there not data centers 1000 meters below the surface of the ocean? Sounds like a no brainer? Prom with the server? Pull it up, fix it, dust it off, send it back down to be cooled

As long as the energy is properly priced according to supply and demand, it won't be an issue. Let these AI companies have the energy, but make sure they pay the price for it.

@ryandgarland

5 күн бұрын

Commercial power rates are typically a fraction of the cost of residential. Same power sold at different rates... surprising? Nah, our system is designed this way. 😅😮.

@bryanjk

5 күн бұрын

@@ryandgarlandyeah but there are many reasons it is that way. Just keep in mind there’s nuance to it

@yourcrazybear

5 күн бұрын

"As long as the energy is properly priced according to supply and demand, it won't be an issue. Let these AI companies have the energy, but make sure they pay the price for it." Yeah. Market forces will fix everything in the long term.

@bob-km4uq

5 күн бұрын

@@yourcrazybear why the fuck did you copy the entire comment you replied to?

@yourcrazybear

22 сағат бұрын

@@bob-km4uq "@yourcrazybear why the fuck did you copy the entire comment you replied to?" So you never heard of a quote before?

First it was Crypto eating up our energy now its A.I lol what's next? Quantum Computing?

@autohmae

5 күн бұрын

You are probably not wrong.

@potencjalnypracownik2966

5 күн бұрын

People are killing the power grid. Protect power grid! It is historical site of ancient technology, must be preserved without change.

@effexon

5 күн бұрын

yah quantum is progressing fast now. there extreme cooling seems the most energy hog. quantum is still niche but Id expect it to grow when it becomes more useful in some real life problems. Although scientists can develop more efficient cooling methods and smaller and smaller quantum computers as time goes on. (some desktop sized setups exist in consumer market already) AI to me seems abyss excess money must be thrown in this madness of capitalism when too much money burns in pocket of companies and businesses, institutions. Id think some wisening up could be done, this one trend at a time where all money is wasted is very dumb when lot of other places would need funding and investment.

@MNIU_

5 күн бұрын

@@effexonI work on cyber and just saw a job posting for Quantum Cybersec engineer … and all I could think is really? I didn’t click on the JD bc I was already doom scrolling on indeed but I could only assume they want a specialty in crypto since that’s where they are kind of at.

brilliant analysis, a very valid exploration. 28k terra watt hrs. Aye Eye -

So when there is rolling blackouts we should blame Ai 😂

The rising cost of electricity will limit the expansion of AI. And there is this problem - 'Arctic Sinkholes'.

Soon, AI (aka SkyNet) will be using its waste heat to process Soylent Green from no longer needed employees.

Touch bases with some of the companies doing microgeothermal there is recoverable thermal energy here.

Place the servers that generate the models near solar and windfarms and run these servers when there is no demand from the grid. So run on free surplus power.

Waste heat is easy to use. Heat a swimming pool, commercial laundry, heat battery, bakery, hospital, etc

@TwoBitDaVinci

5 күн бұрын

yeah it requires cleverness though and coordination, which is next level thinking when people are just trying to get a new data center online ASAP to start making money (the gold rush bit)

@Israel_Two_Bit

4 күн бұрын

You have a good point. But we have to remember that reusing waste heat also requires infrastructure to transport that heat to where it's needed. What if you don't have a pool, a commercial laundry, or a bakery nearby? I think one of the best use cases would be somewhere where they already have a district heating network set up.

@Israel_Two_Bit

4 күн бұрын

In fact, now that I think about it, these types of solutions should be hardwired into all future city designs: a requirement to integrate district heating or some other way to transport waste heat from sources like data centers to where it's needed.

@johnransom1146

4 күн бұрын

@@Israel_Two_Bit there’s all kinds of ways to get businesses to locate like a tax if you don’t, no planning approval etc

Excuse me - do you also fall into the trap of this aww so hot summer?

I'm interested to find out how much energy we have saved over the past 50 years by switching from cathode ray tubes and vacuum tube technology to flat panel IC based technology for the item that we buy hundreds of millions of and that is TVs. Let alone the cost of the energy used to ship all of those heavy glass objects around everywhere. So we have saved countless amounts of money from one sector and put it into this centralized sector which is capable of doing things we only dreamed of 50 years ago

As many countries no longer have a sustainable replacement birth rate, I wonder what impact a 20-40% reduction in population will have on the overall energy consumption? Korea was at 0.72 birth rate in 2023.

They're starting to build chips into phones that can run these AI models without the need for all of that energy................. You can't ignore the advances in efficiency that have been made in just the last year

Keep going down this rabbit hole please 🙏 🍿

The way it’s going, the AI led energy gold rush is definitely underway and it brings the desperate need for professional energy engineers, a brand new technology and discipline that will provide jobs for everyone in future.