Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 5 months agoSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comexternal-linkmessage-square23fedilinkarrow-up1291arrow-down115
arrow-up1276arrow-down1external-linkSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 5 months agomessage-square23fedilink
minus-squareFlumpkin@slrpnk.netlinkfedilinkEnglisharrow-up1arrow-down1·5 months agoHow fast are they with a good GPU?
minus-squareFlumpkin@slrpnk.netlinkfedilinkEnglisharrow-up1·5 months agoSorry, I’m just curious in general how fast these local LLMs are. Maybe someone else can give some rough info.
How fast are they with a good GPU?
Removed by mod
Sorry, I’m just curious in general how fast these local LLMs are. Maybe someone else can give some rough info.