• MangoCats@feddit.it
    link
    fedilink
    English
    arrow-up
    1
    ·
    4 days ago

    Yep. I’m saying that the models I work with through Cursor and Claude Code include those user instructions that are pre-fed into every session. I tell mine to “act like my job title” and it will occasionally pull out some job title related stuff that’s applicable to the situation.

    Of course “behind the scenes” the model vendors can pre-load anything they like, and some of what they pre-load are these so-called “guard rails” that lessen the odds that the model will engage in a chat to assist a suicide, or perpetrate a mass shooting, or fraud, or hacking, or, or, or… the list is long and the success rate is less than 100%, but it does shape the output somewhat in the desired direction.

    Grok famously started calling itself “MechHitler” after one particular update, not hard to guess where that came from.

    • 404found@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 days ago

      That’s interesting. What do you do with AI? You probably know a lot more than I do.