• @teawrecks
    link
    1
    edit-2
    1 month ago

    Oh I see, you’re saying the training set is exclusively with yes/no answers. That’s called a classifier, not an LLM. But yeah, you might be able to make a reasonable “does this input and this output create a jailbreak for this set of instructions” classifier.

    Edit: found this interesting relevant article

    • @sweng@programming.dev
      link
      fedilink
      11 month ago

      LLM means “large language model”. A classifier can be a large language model. They are not mutially exclusive.

      • @teawrecks
        link
        11 month ago

        Yeah, I suppose you’re right. I incorrectly believed that a defining characteristic was the generation of natural language, but that’s just one feature it’s used for. TIL.