Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • punkibas@lemmy.zip
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 hours ago

    At the end of the article they talk about how to overcome this problem for LLMs doing something akin to what you wrote.