0xtr @0xtr - 4mo
For the #LLM experts out there, which #opensource LLM model is the best atm? Don't know if it matters but I will be using it for programming mostly.
Thanks!
TheWildHustle @TheWildHustle - 4mo
Claude 3.5 Sonnet, I've been using PPQ.AI I think Apple just rolled out a fancy new open source LLM tho.
Claude 3.5 Sonnet is proprietary tho
ollama works great for me too but I wanted to use GPT4All (https://github.com/nomic-ai/gpt4all) but had issues downloading new models, constantly getting errors without any explanation. I'll have to look more into it tomorrow.
> Need a lot of hardware to run them though The models doesn't seem to list HW requirements, how do you know if your computer is beefy enough to run them? And arent't they pretrained so you'd only need storage space?
