Via this interview with Rodney (A GPT skeptic according to GPT) Brooks Just Calm Down About GPT-4 Already I found this old (at least in internet terms, it is pre plague, during the first Trump era) blog post which some of you might find interesting to read.

It points out a few flaws with AI hype reasoning which has relevance for our sneering on the LW AGI hype.

  • locallynonlinear@awful.systems
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    1 year ago

    For what it’s worth then, I don’t think we’re in disagreement, so I just want to clarify a couple of things.

    When I say open system economics, I mean from an ecological point of view, not just the pay dollars for product point of view. Strictly speaking, there is some theoritical price and a process, however gruesome, that could force a human into the embodiment of a bird. But from an ecosystems point of view, it begs the obvious question; why? Maybe there is an answer to why that would happen, but it’s not a question of knowledge of a thing, or even the process of doing it, it’s the economic question in the whole.

    The same thing applies to human intelligence, however we plan to define it. Nature is already full of systems that have memory, that can abstract, reason, that can use tools, that are social, that are robust in the face of novel environments. We are unique but not due to any particular capability, we’re unique because of the economics and our relationship with all the other things we depend upon. I think that’s awesome!

    I only made my comment to caution though, because yes, I do think that overall people still put humanity and our intelligence on a pedestal, and I think that plays to rationalist hands. I love being human and the human experience. I also love being alive, and part of nature, and the experience of the ecosystem as a whole. From that perspective, it would be hard for me to believe that any particulart part of human intelligence can’t be reproduced with technology, because to me it’s already abundant in nature. The question for me, and our ecosystem at large, is when it does occur,

    what’s the cost? What role, will it have? What regulations, does it warrant? What, other behaviors will it exhibit? And also, I’m ok not being in control of those answers. I can just live, in a certain degree of uncertainty.