I would suggest trying exllamav3 once, i have no idea what kind of black magic they use but its very memory efficient.

i can’t load Qwen/Qwen3-Coder-30B-A3B-Instruct-FP8 with 16K using vllm

but using exlamav3 i can SOMEHOW load ArtusDev/Qwen_Qwen3-Coder-30B-A3B-Instruct-EXL3:8.0bpw_H8 at its full context of 262.144 with still 2GiB to spare.

I really feel like this is too good to be true and im doing something wrong but it just works so i don’t know.

If I were to guess the biggest peformance impact is if your driver doesn’t support newer types like FP4 and FP8 while your hardware does, but I am not sure.

Forget that the real evil is that the first character of Int or Ganz in this case is capitalized

Why does it matter what is replaced?

I would say if it frees up a human from having to do it that it’s good news.

“must benefit everyone, not just a handful of billionaires”

It’s hard to disagree with that statement but all this upheaval about “killing jobs” seems really pointless to me.

A manual farm has far more employees then one that uses modern machinery, is the economy in decline if the farmer replaces human labor with machines?

The hoodied master hacker hacking the mainframe using HTML…

I really doubt the authenticity of reporting if they use such “tech looking” images

Good stuff, Ukraine has proven again that having a nuclear arsenal is really the only way to ensure a country’s security when faced wirh a hostile nuclear armed neighbor.

Yeah I tried taking a screenshot first but as you can see the screenshot doesn’t include the panel.

This is a PinePhonePro, the experience is surprisingly usable except for one major thing, the battery life is terrible.

Wether that is specific to the PPP, PostmarketOS or if my phone is defective but after like an hour of use the battery is already drained and even in standby the battery won’t last more then 6 hours or so.

There are some minor things here and there but that is the main reason i can’t use it as a daily driver.

Fun thing about linux phones is that they can all look different without vendor lock in

(Yes i aplogize for the scuffed picture put pressing the screenshot button closes the menu)

Haven’t used shotcut or openshot but can recommend kdenlive, it has alot of features but I find it a bit clunky sometimes to work with.

For me when I was working on a large project it crashed once and the autorecover worked, although I still manually save since I’m paranoid.

Ive always wondered how it is ever planned to enforce it, is a police team going to bust down my door:

PUT THE UNBACKDOORED LIBSSL DOWN!

Sure companies like meta will comply instantly but everyone that doesn’t use big tech (including criminals) can just continue doing whatever? Why would criminals the one the law claims to stop use backdoored clients?

I’m selfhosting Forgejo and i don’t really see the benefit of migrating to a container, i can easily install and update it via the package manager so what benefit does containerization give?

Russian MiG-31 aircraft.

Do they not know how to do a simple google search? that’s a MiG-29

This is MiG-31 when viewed from below

This deselects the U.S. Patriot system, which is the most tested Western air defense system.

Qatar had American Patriot and THAAD defenses and Israël could strike anyway with nothing being shot down.

If there is a way to combine this with something like anubis this could be very interesting, then you are also not dependent on the honesty of reading the robots.txt

Have a RSL license? here you go scrape the content.

Trying to freeload? anubis time.

Ofcourse we would all rather see it using EU chips but the hard reality is that they don’t exist.

So the tradeoff becomes can this thing produce more value for the EU using NVIDIA chips now instead of using EU chips someday on a hypothetical future date?

And the awnser is probably yes.

Having something to talk to is a massive improvement over bottling it all up.

AI is very beneficial to people who can’t afford the cost or are otherwise unable/unwilling to speak with a professional.

Well that’s annoying

Wholesome yuri

Sisters that don’t seem to have any romantic relationship

I don’t know about this one chief

My banking app worked with waydroid on linux