I noticed ai likes to assume ur a boy and ignore if ur not. When i played NovelAI it let me ban words so i would add every boy pronoun. Is it there a FOSS selfhosted way? I currently use koboldai with tavernai

  • pavnilschanda@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    5 months ago

    SillyTavern is a fork of TavernAI that lets you do more things. Perhaps look into that? Also you can just adjust the system prompt to have the LLM assume that you’re not a boy.

    • mariah@feddit.rocksOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      5 months ago

      I tried SillyTavern but the ui looked terrible. Do i put “i am a girl” in the prompt? How will it know im talking about me not the character

      • pavnilschanda@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        5 months ago

        If you use the persona system, you can put “<insert persona name> is a girl”, otherwise “Refer to me as a girl throughout the conversation” would be fine

        • mariah@feddit.rocksOP
          link
          fedilink
          English
          arrow-up
          2
          ·
          5 months ago

          It worked. Thanks. Another question, how do i stop the random person who says get a room and similar?

          • pavnilschanda@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            5 months ago

            What kind of LLM are you using? Depending on its effectiveness, you can put “this is a chat between you and me” (or whatever you and AI identify as) in the system prompt.

            • mariah@feddit.rocksOP
              link
              fedilink
              English
              arrow-up
              2
              ·
              5 months ago

              I am using DavidAU/Psyonic-Cetacean-Ultra-Quality-20b in koboldai horde. I plan to selfhost tho when i get my 3090 installed

              • pavnilschanda@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                5 months ago

                OK, I gave it a look and it said that it’s good at following instructions, so the aforementioned advice would still apply

                • mariah@feddit.rocksOP
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  5 months ago

                  I actually found the ai koboldcpp/crestfall-mythomax-L2-13b-q5_k_m works perfectly

  • keepthepace@slrpnk.net
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    5 months ago

    It would probably be more effective to put an explicit mention in the system prompt. “Your interlocutor is a <gendered term> and will be greatly offended to be refered to as a boy or a man.”

  • projectmoon@lemm.ee
    link
    fedilink
    English
    arrow-up
    2
    ·
    5 months ago

    KoboldCPP has ban tokens that prevent those tokens from being output. Otherwise just put it in the prompt and it should probably work.