While personally I’m not using them for work, just tinkering, 128GB can run qwen 3.8 flash next at q4(~111GB gguf). That model seems to be quite capable from what I’ve read.
It’s quite evident that the api models can and have been nerfed at the provider’s discretion, then there’s the abliteration aspect too(api models refusing what they consider “harmful”) which makes the case for local.
It’s quite evident that the api models can and have been nerfed at the provider’s discretion, then there’s the abliteration aspect too(api models refusing what they consider “harmful”) which makes the case for local.