1. lol at Kevin Roose smashing together three different bits of marketing collateral for three different models into one sentence
  2. Would love to hear him explaining "refactor a code base" then show me where that happened
Kevin Roose
@kevinroose
There's a fascinating tension between what Al labs are building (PhD-level agents that win math olympiads and refactor code bases) and what most people want out of Al (friendly helpers that are pretty smart and can do stuff and don't get a personality transplant every 6 months).
typedfemale &
@typedfemale • 11h
the /r/chatgpt AMA is mostly people begging for gpt-40 back because of it's personality... really not what i expected! pic.x.com/XPG2iGhzcM

Replies

  1. can't get over the "friendly helper" bit. bro we had clippy and nobody liked him, even though he WAS helpful. i want my computer to do computer things and my friends to do friend things.

    0
  2. The math olympiad thing is so funny because these things are inarguably worse at math than just a computer. Just plugging things into already existing tech like Wolfram Alpha or a fucking graphing calculator gives faster and better answers.

    0
  3. Having a PhD and winning a Math Olympiad are 2 very different achievements. I tried to do Math Olympiads as a kid and basically anybody advancing to the national level is on a different plane of existence, even compared to the relatively gifted kids competing in first place.

    2
  4. Refactoring a code base is absolutely not what these things do. Even among my colleagues who use AI coding tools and have good things to say, their process tends to be one of let the AI write a bunch of crap, and then you the engineer refactor it to make it work and bring it up to standards

    2
  5. Concerning to me so many people were that in tune with a "personality." I have a strong suspicion many more cases of the LLM chat psychotic breaks from reality are on the way.

    1
  6. if they could competently refactor production-sized code bases that would be a reason for me to start caring, frankly.

    Ironically the most annoying parts of coding are annoying because of the amount of context you have to hold in your head, the very thing AI is worse at than you.

    2
  7. He wrote such a great book about experimenting with being a transfer student for one semester at Liberty University. It's such a shame to see him become...this.

    0
  8. Every time I think "maybe Ed is being too hard on these guys" I read them uncritically barfing up the AI marketing bullshit while pretending to say something smart and I go, "oh nevermind."

    1
  9. Also would love to hear explanation of “win math olympiads” vs “get scores that would entitle them to gold medals were they allowed as competitors but that would NOT have “won” because bunch of humans got perfect scores on all six problems and therefore “won””.

    0
  10. PhD level work is…(checks notes)…pretending to solve math problems from a competition for high schoolers, and pretending to do work that hobbyists and software engineers with CS bachelors degrees do every day.

    0
  11. Sure, we'll let your AI refactor our 5000 file codebase that we spent 6 years and million$ building, sure hold on one second...

    <reaches into bottom drawer for pistol, loads it, clicks safety off>

    ...hang on, I have something here you need to know before you start.

    🙄

    0
  12. I work at a place with access to the very very latest versions of all of this stuff and "refactor a code base" is more like "do something slightly more complex than a search/replace with a whole lot of safeguarding and hand-holding and still having humans verify every change"

    1
  13. The bizarre dichotomy of ChatBots being sold as this thing you’re supposed to want to pay 100’s of thousands of dollars a year for to solve science and a glorified parlor trick. Which is it? No one sells a nuclear reactor by talking about its ability to create topless pictures of Taylor swift.

    0
  14. Listening to Kevin and Casey is like listening to a couple of school kids on an episode of "Kids Say the Darndest Things"... except actual kids ask actually interesting and tough questions.

    (Speaking as someone who paid for Casey's work for a period... uuurgh! Now I pay for yours 😄)

    0
  15. i believe AI is overhyped, hate Sam Altman and all billionaires, know it’s destroying the environment, etc. but i’m also a working developer and AI really can do a lot of code refactoring.

    2
  16. How come we don’t have any decent home assistants that use AI to actually assist in the home? Why aren’t all my smart home devices super easy to use now?

    0
  17. what the fuck is a phd level agent

    computers are supposed to be good at maths!

    why do they all talk like they've never seen another human being before

    1
  18. i feel like people like kevin have absolutely no experience with phds and just think of them as "the smartest people"

    2