Ape Mithrandir on Nostr: Self-hosted depends on your hardware. If you want something good it costs money. I ...

Self-hosted depends on your hardware. If you want something good it costs money. I can run 30bn parameters with FP8 quantization on my HW.