Recursion into madness

(blog.coredump.cx)

42 points | by surprisetalk 3 days ago

10 comments

  • jrochkind1 56 minutes ago
    > PS. For obvious reasons, this post will fail Pangram tests.

    Actual pangram to me says it's 100% human. Current pangram can flag different passages differently, but these are all flagged human by it, even the LLM written ones.

  • GPerson 40 minutes ago
    Does the same effect happen in a society which rewrites all of its knowledge over and over using AI?
  • pattt 2 hours ago
    It would be interesting how many iterations of LLM-based PR reviews and fixes it takes to turn the code into horror. It’s already started happening.
  • Muromec 3 hours ago
    It doesn't merely stabilise, it almost converges on itself
  • MarkusQ 2 hours ago
    It would have been interesting to try something closer to the movie poster example; say have the AI rewrite the passage with the room toggling between the initial light-mode decor and a dark-mode decor, then back, repeatedly. Or even change the woman's name to "Mrs. Smythe" and back.
    • layer8 2 hours ago
      As the article explains: “[…] In other words, if you instruct a model to change a single word in a paragraph of text, it can almost always handle the task with no collateral damage.“
  • groby_b 3 hours ago
    The existence of attractors (e.g. "stable at iteration 31") for AI models is one of the weirdest things in AI land. They are a wonderful space to explore, fascinating and full of horrors.

    Meanwhile, my hat's off to the (currently) last comment on the page: "I like how the shear-sheathed legs still earned their keep — probably load-bearing for Mrs. Regan"

  • roger_maddux_iv 1 hour ago
    [dead]
  • michaelmrose 1 hour ago
    [dead]
  • amelius 3 hours ago
    The same happens with humans, in e.g. chain stories, cumulative stories, etc.

    Not unique to AI.

  • lowbloodsugar 3 hours ago
    >I don’t write about generative AI much. Everyone else does; not much of consequence ever gets said.

    I see he chose not to break with tradition.