The economy and national security after AGI | Carl Shulman (Part 1)

Part 2: • Government and society...
The human brain does what it does with a shockingly low energy supply: just 20 watts - a fraction of a cent worth of electricity per hour. What would happen if AI technology merely matched what evolution has already managed, and could accomplish the work of top human professionals given a 20-watt power supply?
Many people sort of consider that hypothetical, but maybe nobody has followed through and considered all the implications as much as Carl Shulman. Behind the scenes, his work has greatly influenced how leaders in artificial general intelligence (AGI) picture the world they're creating.
Learn more and find the full transcript on the 80,000 Hours website: 80000hours.org/podcast/episod...
Carl simply follows the logic to its natural conclusion. This is a world where 1 cent of electricity can be turned into medical advice, company management, or scientific research that would today cost $100s, resulting in a scramble to manufacture chips and apply them to the most lucrative forms of intellectual labour.
It's a world where, given their incredible hourly salaries, the supply of outstanding AI researchers quickly goes from 10,000 to 10 million or more, enormously accelerating progress in the field.
It's a world where companies operated entirely by AIs working together are much faster and more cost-effective than those that lean on humans for decision making, and the latter are progressively driven out of business.
It's a world where the technical challenges around control of robots are rapidly overcome, leading to robots into strong, fast, precise, and tireless workers able to accomplish any physical work the economy requires, and a rush to build billions of them and cash in.
As the economy grows, each person could effectively afford the practical equivalent of a team of hundreds of machine 'people' to help them with every aspect of their lives.
In today's episode, Carl explains the above, and host Rob Wiblin pushes back on whether it's realistic or just a cool story.
• Cold open [00:00:00]
• Rob’s intro [00:01:00]
• Transitioning to a world where AI systems do almost all the work [00:05:21]
• Economics after an AI explosion [00:14:25]
• Objection: Shouldn’t we be seeing economic growth rates increasing today? [00:59:12]
• Objection: Speed of doubling time [01:07:33]
• Objection: Declining returns to increases in intelligence? [01:11:59]
• Objection: Physical transformation of the environment [01:17:39]
• Objection: Should we expect an increased demand for safety and security? [01:29:14]
• Objection: “This sounds completely whack” [01:36:10]
• Income and wealth distribution [01:48:02]
• Economists and the intelligence explosion [02:13:31]
• Baumol effect arguments [02:19:12]
• Denying that robots can exist [02:27:18]
• Classic economic growth models [02:36:12]
• Robot nannies [02:48:27]
• Slow integration of decision-making and authority power [02:57:39]
• Economists’ mistaken heuristics [03:01:07]
• Moral status of AIs [03:11:45]
• Rob’s outro [04:11:47]
----
The 80,000 Hours Podcast features unusually in-depth conversations about the world’s most pressing problems and what you can do to solve them.

Пікірлер: 29

  • @Sporkomat
    @SporkomatАй бұрын

    Love Carl Shulman, always so insightful

  • @sikunowlol
    @sikunowlolАй бұрын

    honestly.. need part 2 ASAP

  • @JuliusNkemdiche
    @JuliusNkemdicheАй бұрын

    Fascinating talk and thought experiment

  • @JD-jl4yy
    @JD-jl4yyАй бұрын

    When will the world finally wake up to the irreversible transition society is about to undergo? We are living at the dusk of the Old World.

  • @MrNote-lz7lh

    @MrNote-lz7lh

    26 күн бұрын

    They'll wake up a few months after the change takes place.

  • @NenJiDaPassiv

    @NenJiDaPassiv

    24 күн бұрын

    After the fact, of course haha😅

  • @BadWithNames123
    @BadWithNames123Ай бұрын

    that video image is freaking me out ^^

  • @sebkflex
    @sebkflex22 күн бұрын

    Excellent as always

  • @Thedeepseanomad
    @ThedeepseanomadАй бұрын

    The question is why you quantize resources in $ in a AGI economy.

  • @MrNote-lz7lh

    @MrNote-lz7lh

    26 күн бұрын

    Because bargaining is extremely inefficient and even agi would want a clear production value of something to work out how much of what should be produced.

  • @nosteinnogate7305

    @nosteinnogate7305

    20 күн бұрын

    In what else, apples?

  • @martyr84

    @martyr84

    19 күн бұрын

    Agi will move the cost of labor to the cost of compute. A infinite energy economy on the other hand is a totally different story. Thats when pricing things in $ won’t make sense.

  • @odiseezall
    @odiseezallАй бұрын

    Profoundly disagree with the anthropomorphism at the end of the conversation and giving moral status to AIs - if we build AI tools that require moral status, we have failed. Creating AI creatures, agents and fake-humans will be our downfall.

  • @Thedeepseanomad

    @Thedeepseanomad

    29 күн бұрын

    @@odiseezall I agree insofar that if we create something that requires moral status, we are not creating tools, we are creating members of our society. That is all well and fine, unless we trying to create tools instead of companions or moral agents. The point of having a tool is that you can use them as such, and the evil of slavery was that moral agents with interests were used as tools.

  • @BilichaGhebremuse
    @BilichaGhebremuse29 күн бұрын

    Good overview on AI

  • @firstnamesurname6550
    @firstnamesurname6550Ай бұрын

    Where is Jürgen?

  • @xbluebells
    @xbluebellsАй бұрын

    So will robots make our "best friends". Our society has vast amount of future things to decide in the near future. I think when robots experience pain is when we really need to be careful with the idea of exploitation. How to determine the subjective experience of a robot is a hurdle we must come to terms with in the future.Woot! I listened to the whole 4 hours!

  • @Thedeepseanomad

    @Thedeepseanomad

    Ай бұрын

    It would really be pointless and a moral evil to create a artificiell workforce with interests, at the very least interested in other things than working with producing resources for humans.

  • @life42theuniverse
    @life42theuniverse5 күн бұрын

    Will AGI need time off for back propagation?

  • @ImperatorMo
    @ImperatorMoАй бұрын

    gud stuff

  • @sikunowlol
    @sikunowlolАй бұрын

    great talk!

  • @Charvak-Atheist
    @Charvak-AtheistАй бұрын

    Wow

  • @calvinsylveste8474
    @calvinsylveste8474Ай бұрын

    Economists are hesitant to extrapolate the full impacts of competent AI for fear of appearing crazy to their peers. These capabilities could indeed lead to sci-fi-like outcomes and potentially render their profession obsolete. Most economists will choose to focus on maintaining the status quo until retirement, only updating when new AI capabilities emerge. It's a species of intellectual cowardice.

  • @ili626
    @ili626Ай бұрын

    This requires packing the court. What other choice it there? But we may only have to early January 2025

  • @rodneyericjohnson
    @rodneyericjohnsonАй бұрын

    Why is Elon Musk on the thumbnail?

  • @NenJiDaPassiv

    @NenJiDaPassiv

    24 күн бұрын

    The more poignant question is why you didn't mention Bezos and both of them seemingly in the position of waiters 😊

  • @ahabkapitany
    @ahabkapitanyАй бұрын

    FIRST

  • @michelleelsom6827
    @michelleelsom6827Ай бұрын

    WHY is he ( the host) talking so crazily fast?? Does he want folks to switch off?? Luckily the guest talks in a way much more comfortable to listen to.

  • @life42theuniverse

    @life42theuniverse

    5 күн бұрын

    Watching 2x?