Wondering about services to test on either a 16gb ram “AI Capable” arm64 board or on a laptop with modern rtx. Only looking for open source options, but curious to hear what people say. Cheers!
Wondering about services to test on either a 16gb ram “AI Capable” arm64 board or on a laptop with modern rtx. Only looking for open source options, but curious to hear what people say. Cheers!
I use OLlama & Open-WebUI, OLlama on my gaming rig and Open-WebUI as a frontend on my server.
It’s been a really powerful combo!
Would you please talk more about it. I forgot about Open-webui, but intending to start playing with. Honestly, what do you actually do with it?
I have Linkwarden pointed at my ollama deployment, so it auto tags links that I archive which is nice.
I’ve seen other people send images captured on their security cameras on frigate to ollama to get it to describe the image
There’s a bunch of other use cases I’ve thought of for coding projects, but haven’t started on any of them yet
Sex chats. For other uses, just simple searches are better 99% of the time. And for the 1%, something like the Kagis FastGPT helps to find the correct keywords.