What the title says. Are there any good ChatGPT alts that can be self hosted?

  • zephyrvs@lemmy.ml
    link
    fedilink
    arrow-up
    5
    ·
    1 year ago

    Llama.cpp + Wizard Vicuna (Uncensored, if you want to get the real thing) + one of the web interfaces that are compatible. Should be listed in the readme.

    Or try gpt4all which is much easier to use and even offers a selection of downloadable models.

    7B/13B/30B+ depends on your hardware, especially GPU.