stabby_cicada@slrpnk.net to solarpunk memes@slrpnk.net · 1 day agoone more shitty techbrofad downslrpnk.netimagemessage-square119fedilinkarrow-up1420arrow-down147file-text
arrow-up1373arrow-down1imageone more shitty techbrofad downslrpnk.netstabby_cicada@slrpnk.net to solarpunk memes@slrpnk.net · 1 day agomessage-square119fedilinkfile-text
minus-squarePriorityMotif@lemmy.worldlinkfedilinkarrow-up6·6 hours agoYou can run it on your own machine. It won’t work on a phone right now, but I guarantee chip manufacturers are working on a custom SOC right now which will be able to run a rudimentary local model.
minus-squareTherapyGary@lemmy.blahaj.zonelinkfedilinkarrow-up4·5 hours agoYou can already run 3B llms on cheap phones using MLCChat, it’s just hella slow
You can run it on your own machine. It won’t work on a phone right now, but I guarantee chip manufacturers are working on a custom SOC right now which will be able to run a rudimentary local model.
You can already run 3B llms on cheap phones using MLCChat, it’s just hella slow