While an interesting read, my comment isn’t directed at advanced users that know their stuff. Also, not everyone own a beast, most users have a medium or low tier PC. Funnily, 16GB of RAM for your usage seems low. Double that and you’ll never need swap unless you want to play with the biggest local LLMs via Llama.ccp. But then, you likely have a GPU beast.
Sadly, i don’t think GPU prices will ever drop. The only reason would be if a new competitor comes up with something on par or better than the current tech. For CPUs, we’ve reached the limit already. Nonetheless, their’s still some hope with a tech called optical computing.
Computer power increase became meaningless because companies juste use it as an excuse to not optimize their software anymore. The best exemple is how everyone basically uses a whole browser (chromium ) just to show some GUI. The steam client and discord are two big software that comes in mind using this but it’s spreading fast and I found a GUI for aria2c that weights more than 60mb while aria2c itself is a few megs, but even worse some manufacturers are using it for their mouse and keyboard drivers for god sake.
Removed by mod
While an interesting read, my comment isn’t directed at advanced users that know their stuff. Also, not everyone own a beast, most users have a medium or low tier PC. Funnily, 16GB of RAM for your usage seems low. Double that and you’ll never need swap unless you want to play with the biggest local LLMs via Llama.ccp. But then, you likely have a GPU beast.
Removed by mod
Sadly, i don’t think GPU prices will ever drop. The only reason would be if a new competitor comes up with something on par or better than the current tech. For CPUs, we’ve reached the limit already. Nonetheless, their’s still some hope with a tech called optical computing.
Computer power increase became meaningless because companies juste use it as an excuse to not optimize their software anymore. The best exemple is how everyone basically uses a whole browser (chromium ) just to show some GUI. The steam client and discord are two big software that comes in mind using this but it’s spreading fast and I found a GUI for aria2c that weights more than 60mb while aria2c itself is a few megs, but even worse some manufacturers are using it for their mouse and keyboard drivers for god sake.