Hello, I’m currently using GPT4All on Debian, I was wondering, how do you get the AI to do whatever you want? I’m using the Nous Hermes 2 Mistral DPO model.

  • liliumstar@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    16
    ·
    9 months ago

    You generally want to use a model which has been fine tuned to work around the inbuilt censorship. There are plenty available on huggingface currently. It’s not a perfect solution, but works well enough for what it is.

    I would suggest using the llama.cpp backend with a frontend of your choosing.

  • PerogiBoi@lemmy.ca
    link
    fedilink
    arrow-up
    12
    ·
    9 months ago

    You need to download and run an unrestricted model. Take a look at thebloke models (there’s an uncensored 13b vicuna and wizard model).

    Even with uncensored models, you sometimes need to pre-prompt it to answer certain queries as it talks about “ethics” and “morality”.

  • OsrsNeedsF2P@lemmy.ml
    link
    fedilink
    arrow-up
    4
    arrow-down
    3
    ·
    9 months ago

    It’s all in the prompting. Test yelling at it, making it pretend do be something else, etc