I’m trying to figure out how to host one myself. I’m trying to use barvarder and localai. But I am failing due to not enough knowledge and missing instructions. Any advice? did someone succeed with anything? I’d be happy to make other smaller steps at first as well. As long as I get somewhere.

  • das@lemellem.dasonic.xyz
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Surge is probably the easiest way to get a basic setup. If you just want to download a model and chat, I recommend it.