A software developer and Linux nerd, living in Germany. I’m usually a chill dude but my online persona doesn’t always reflect my true personality. Take what I say with a grain of salt, I usually try to be nice and give good advice, though.

I’m into Free Software, selfhosting, microcontrollers and electronics, freedom, privacy and the usual stuff. And a few select other random things, too.

  • 9 Posts
  • 2.56K Comments
Joined 11 months ago
cake
Cake day: June 25th, 2024

help-circle



  • I’d say you’re probably right with the appointed internet sheriff. Quite some people here strive for a nice atmosphere, and Lemmy to be a particularly good realization of social media. That directly translates to the rules we make up for specific corners of it. And since social media is all about attention, this is the “handle”. I think it’s Privacyguide’s obligation. They can choose which place they call home and whom they bond with.





  • Ich frag mich immer wer das so bemerkenswert findet. Also das ist ja jetzt seine zweite oder dritte Aktion dieser Art?! Aber mich wundert es nicht besonders, dass Betrug funktioniert… Das tut er ja regelmäßig auch bei anderen Leuten.

    Und ich find die ganze Urkundenfälschung, Medallien und so auch ein wenig fade. Warum nicht mal die eigenen Punkte in Flensburg entfernen lassen? Oder 'nem unsympathischen Politiker oder Großkonzern ans Bein pinkeln? Das wäre wenigstens unterhaltsam.


  • I think it’s kind of hard to quantify the “better” other than measure perplexity. with Q3_XS or Q2 it seems to be a step down. But you’d have to look closely at the numbers to compare 12b-q4 to 27b-q3xs. I’m currently on mobile so I can’t do that, but there are quite some tables buried somewhere in the llama.cpp discussions… However… I’m not sure if we have enough research on how perplexity measurements translate to “intelligence”. This might not be the same. Idk. But you’d probably need to test a few hundred times or do something like the LLM Arena to get a meaningful result on how the models compare across size and quantization. (And I heard Q2 isn’t worth it.)



  • If you trust the measurements in perplexity which people occasionally publish on the llama.cpp project page or in some papers, the ability to run a larger model completely dwarfes the slight loss introduced by the quantization. That holds true to a level like Q4 or so. If you look at the perplexity numbers, they’re not far away from 8bit or full precision. And then it starts to deteriorate faster with Q3 and Q2, if I remember correctly. I always try to fit the largest model I can at something between Q4 and Q8. I can’t notice any major difference to full precision, though theoretically every step of quantization is going to lower quality by a tiny amount.







  • I’m not sure if that’s LLMs. I long suspected people to copy popular Reddit posts/stories here to gain attention. I’ve searched for some and they don’t all seem to be dumped here from other places, so it has to be something else. But so far I didn’t use any LLM detector service to find out if people made them up on their own or used ChatGPT… We might want to do that to gain some more insight.

    But it’s very annoying. I’ve unsubscribed from asklemmy and several other popular communities, because of this.


  • I’ve never had a look at the code of a major commercial platform, so I don’t really know whether those options do something. But sure. I’m not relying on it too much. I regularly decline and switch everything off. And I hope they at least honor my setting to not sell my data to third parties… But I don’t invest a lot of time into this, I don’t trust them so I rather avoid giving them too much data in the first place.

    I’m curious how they’re going to monetize services like ChatGPT. Whether they put ad banners on the website and app, or make the chatbot recommend certain products to you…



  • I don’t think there is a valid reason to this. I mean they offer several other services as well. But I think many, many people use it instead of other web application firewalls, because Cloudflare are good snake-oil salesmen and everyone else is using it too, so it must be valid. And there is a free tier, and nobody cares giving away their and their customer’s private data and introducing one big single point of failure to the internet…