Show HN: TurboGPT: train 22KiB transformer in 13s

(github.com)

41 points | by lostmsu 4 hours ago

6 comments

  • _345 30 minutes ago
    Trying to be a little less negative than the guy that got flagged, I too don't understand the motivation behind these projects. I've seen a hundred of them at this point- and each of them is probably worse and has less learning value than the one Andrej Karpathy made to teach people the building blocks involved in a GPT

    So, why do people keep making these? Asking genuinely

  • vjsrinivas 1 hour ago
    Interesting trend of labeling models after how big they are on disk vs how many learnable parameters they have.
  • w4yai 53 minutes ago
    "hn1g.txt" => not available
  • jey 2 hours ago
    At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little
  • pane_poker_11 1 hour ago
    [dead]
  • fleshmonad 1 hour ago
    [flagged]
    • kadoban 1 hour ago
      Jesus. Would hate to see the work you _do_ want to shit on.