Our Smallest, Most Efficient Model: Muse Ember

(research.meta.ai)

31 points | by dvaplima 51 minutes ago

6 comments

  • simonw 22 minutes ago
    Six effort levels (minimal, low, medium, high, xhigh, max), so here are six pelicans (actually five, "high" didn't return a complete SVG):

    https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

    There's usually a reasonably strong correlation between thinking level and visual quality of the pelican. This is the first time I've seen that correlation appear to break - more reasoning tokens doesn't seem to produce an obviously better SVG.

    • imimayj1337 9 minutes ago
      It does pretty insane to me that only on max setting (and after waiting 27 seconds) did you actually manage to receive an SVG where the pelican's legs are straddling the bike correctly.
    • meric_ 11 minutes ago
      Wow, minimal seems to be the best here interestingly. Only 10 reasoning tokens so basically none?
    • permalac 9 minutes ago
      Is there a problem if I like the minimal more than the others?
    • sjacob 10 minutes ago
      Incredible. How do you get these out so fast?
    • AmazingTurtle 16 minutes ago
      [dead]
  • open-paren 10 minutes ago
    I believe this is what the “crouton alpha” stealth model was

    https://openrouter.ai/stealth/crouton-alpha

  • gopalv 3 minutes ago
    Model refusals should be a -ve score, not zero?

    Treating the refusal as a 0 score erases the difference between lack of capability and a lack of willingness to perform.

  • dom96 3 minutes ago
    Super frustrating that I still can’t give Muse Wonder Full a spin.
  • Starlevel004 10 minutes ago
    Luna 6 is getting a bit long in the teeth now. It's two full months old, but it was only a slight step above Luna 5.6, which was already four months old (Imagine saying this about anything else). So I'm not too surprised that a newer small model is beating it handily. I've been hoping for Luna 6.1/2 as the next model release for a few days now.
    • esafak 3 minutes ago
      Uniquely among models I've tried, Luna 6 is infuriatingly lazy. As if it expects me to do the work, unaware that it is a tool.
  • caaqil 8 minutes ago
    I'm always a bit surprised to see Meta talking about models. They have become (almost*) entirely irrelevant to the LLM race, which is weird because their AI lab used to be decent before LLM was cool.

    What happened to zuck? Was the metaverse this destructive?

    (*) Feeling charitable today

    • achandra03 4 minutes ago
      Isn't Muse Wonder at or at least very close to the frontier? Considering they essentially started from scratch after rebooting their AI efforts post-Llama 4 about a year ago it's pretty solid progress.
    • StarlessHours 3 minutes ago
      Meta is trying to stay relevant. They fell behind after llama 4, hired new talent and re-organized.
    • esafak 6 minutes ago
      They have started to catch up; the Spark series is good.