53% unfavorable is not ‘in the dumpster,’ unfortunately:
https://d3nkl3psvxxpe9.cloudfront.net/documents/econTabReport_haeOEK5.pdf
https://www.economist.com/interactive/trump-approval-tracker
It’s better than his first term, and we re-elected him… If COVID couldn’t penetrate the bubble, I honestly don’t know what will.
Devil’s advocate: that’s not counting salaries (which would be subtracted from profits first).
The oil industry is still literally criminal and destroying the world, though.
It’s not like the sane among us are suddenly going to decide to go along with fascism
Oh you underestimate people’s self interest. If Big Tech continues on it’s trajectory to a kind of Theil-ish cyberpunk dystopia, most people are going to go along. Like, even I have super techy naturalized family that keeps using Google or Facebook stuff. It’s (seemingly) too essential.
That’s optimistic.
It’s assuming the Dem Party doesn’t sabotage their own candidates. It’s assuming they don’t campaign like it’s 1960 again. It’s assuming social media will somehow be reigned in.
It’s assuming there will even be a fair environment for an election, instead of the government (and whoever’s conflated with them) putting thumbs on the scales kinda like Hungary, or worse. It doesn’t take much pressure to sway elections in environments this polarized.
We have to shout for him
We can’t.
The people who need to hear it are in another bubble and never will.
TBH I dunno how to fix it anymore. Even ‘revolution’ like many on Lemmy fantasize about will not penetrate, and most people don’t want to understand what propaganda and algos are doing to them.
Ouch. Way too close to home.
upvote
You can definitely quantize exl3s yourself; the process is vram light (albeit time intense).
What 13B are you using? FYI the old Llama2 13B models don’t use GQA, so even their relatively short 4096 context takes up a lot of vram. Newer 12Bs and 14Bs are much more efficient (and much smarter TBH).
Deported
We got some scary tools now though. We’ve never been able to fuck up the planet at this scale.
Look at the metrics. 4.3M views, boosted hate replies. Blue check.
Twitter and propaganda like it is why this is happening.
In the future, when we’re transcendent tentacled robofurries doing poly in virtual space, on drugs (think Yivo from Futurama), we will look back in confusion at why so many people hate homosexuality so much. Like… don’t they have other things to worry about?
Or humanity will be all dead, I guess.
And I’m talking about the mega conservatives protesting this; at least the Vatican is baby stepping and trying to minimize their cruelty.
Here, we are safe. Here, we are free.
Been trying to play with this in ik_llama.cpp, and it’s a temperamental model. It feels deep fried, like it wants to be smart if it would just stop looping or getting its own think template wrong.
It works great in 24GB VRAM though. I’m getting like 16 tok/sec at longish context, with 15 experts on the GPU and the rest offloaded.
Rimworld’s DLCs are kinda assumed purchases for the modding scene, too. I feel like this drives a lot of their sales TBH.
I have the feeling that as soon as it ends up offloading some of the model into system ram is going to slow down to a crawl.
Then don’t offload! Since its 3000 series, you can run an exl3 with a really tight quant.
For instance, Mistral 24B will fit in 12GB with no offloading at 3bpw, somewhere in the quality ballpark of an Q4 GGUF: https://cdn-uploads.huggingface.co/production/uploads/6383dc174c48969dcf1b4fce/tfIK6GfNdH1830vwfX6o7.png
It’s especially good for long context, since exllama’s KV cache quantization is so good.
You can still use kobold.cpp, but you’ll have to host it via an external endpoint like TabbyAPI. Or you can use croco.cpp (a fork of kobold.cpp) with your own ik_llama.cpp trellis-quantized GGUF (though you’ll have to make that yourself since they aren’t common… it’s complicated, heh).
Point being that simply having an ampere (3000 series RTX) card can increase efficiency massively over a baseline GGUF.
Well, .world has no high horse to sit on. I see Rawstory (https://en.wikipedia.org/wiki/Wikipedia:Reliable_sources/Perennial_sources#The_Raw_Story), Dailybeast, Mediaite or blue-check Twitter screenshots pretty much every time I open the front page.
Itjustwork’s page actually seems better… Guess I’m on the wrong instance, heh.
Coffee Stain’s another good example on the bigger end.
It does seem like there’s a danger zone behind a certain size threshold. It makes me worry for Warhorse (the KCD2 dev), which plans to expand beyond 250.
Funny thing is Teslas already have something more sophisticated. They could pipe the FSD’s diagnostics to a HUD as a more polished, standard ‘overlay’ for the driver, literally run with the car’s own hardware. You’d think Tesla execs would know about that since it’s literally their business, and predates the LLM craze.
…But no.
This is so stupid.
To me, “AI” in a car would be like highlighting pedestrians in a HUD, or alerting you if an unknown person messes with the car, or maybe adjusting mood lighting based on context. Or safety features.
…Not a chatbot.
I’m more “pro” (locally hostable, task specific) machine learning than like 99% of Lemmy, but I find the corporate obsession with cloud instruct textbots bizarre. It would be like every food corp living and breathing succulents. Cacti are neat, but they don’t need to be strapped to every chip bag, every takeout, every pack of forks.
Fair point! I am not up to date TBH.
I guess I’m pretty jaded too. The DNC getting things together!? What is this?