this post was submitted on 12 Mar 2024
177 points (100.0% liked)
Technology
38569 readers
347 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I think the advancement of LLMs, which culminated in the creation of ChatGPT, is this generation's Eternal September. In a couple of decades, we'll talk about how the internet "used to be" before free, public websites were abandoned because our CAPTCHAs could no longer filter out bots and device attestation and continuous mictopayments became the only way to keep platforms spam free.
Even when Microsoft and OpenAI stop hemorrhaging money by giving away stuff like ChatGPT for basically free, the spam farms will run this stuff on their own soon. I expect a wave of internet users to get upset and call paying for used services "enshittification", because people don't realise how much running these AI models actually costs.
I think this will also start the transition of not only AI being sold like Netflix or like mobile data caps, but also to an "every company that doesn't get the most expensive AI will start lagging behind" economy. After all, AI only needs to cost a little less than the manpower it's replacing. Any internet facing company needs good AI to outwit the AI trying to abuse cheap or free services (like trials) that they may offer.
We're probably lucky that AI spammers haven't discovered the Fediverse yet, but if the Fediverse does actually become big enough for mainstream use, we'll see Twitter level reaction spam in no time, and no amount of CAPTCHAs will be able to stop it.
Part of what makes Twitter, Reddit, etc. such easy targets for bot spammers is that they're single-point-of-entry. You join, you have access to everyone, and then you exhaust an account before spinning up 10 more.
The Fediverse has some advantages and disadvantages here. One significant advantage is that -- particularly if, when the dust finally settles, it's a big network of a large number of small sites -- it's relatively easy to cut off nodes that aren't keeping the bots out. One disadvantage, though, is that it can create a ton of parallel work if spam botters target a large number of sites to sign up on.
A big advantage, though, is that most Fediverse sites are manually moderated and administered. By and large, sites aren't looking to offload this responsibility to automated systems, so what needs to get beaten is not some algorithmic puzzle, but human intuition. Though, the downside to this is that mods and admins can become burned out dealing with an unending stream of scammers.
We had a bunch of Japanese teenagers run scripts on their computers and half the Fediverse was full of spam. If someone really cared about spamming, this shit wouldn't stop as quickly.
No Fediverse tools have sufficient spam prevention measures right now. The best we have is individually blocking every server, but there are thousands of servers that can be abused by a very basic account creation + spam script.
Manal moderation will lead to small/single user instances getting barred from participating, leading back to centralisation on a few vetted servers. We need automated tools, across all parts of the Fediverse, or the network will be in a constant flux between waves of spam and overbearing defederation to fight the spam waves. Especially once spammers start bypassing CAPTCHAs.
The upside of that attack is that instance Admins had to raise their game and now most of the big instances are running anti-spam bots and sharing intelligence. Next time we'll be able to move quickly and shut it all down, where this time we were rather scrambling to catch up. Then the spammers will evolve their attack and we'll raise our game again.
It's true that the toolset isn't here now, and the network is actually very fragile at the moment.
It's also true that platform builders don't seem to want to deal with these kinds of tools, for raisins.
But it's also true that temporary blocks are both effective and not that big of a deal.
I'm not sure why you'd think that manual moderation will lead to small instances getting barred, though. Unless you're predicting that federation will move to whitelisting, rather than blacklisting? That's historically been the tool of corporate services, not personal or community ones.
If it really ramps up, we could share block lists too, like with ad blockers. So if a friend (or nth-degree friend) blocks someone, then you would block them automatically.
That work has already started with Fediseer. It's not automatic, but it's really easy, which is probably the best we'll get for a while.
I am so tired of this bullshit. Every time I've turned around, for the past thirty years now, I've seen some variation on this same basic song and dance.
Yet somehow, in spite of supposedly being burdened with so much expense and not given their due by a selfish, ignorant public, these companies still manage to build plush offices on some of the most expensive real estate on the planet and pay eight- or even nine-figure salaries to a raft of executive parasites.
When they start selling assets and cutting executive salaries, or better yet laying them off, then I'll entertain the possibility that they need more revenue. Until then, fuck 'em.
What "entitlement?"
I don't expect anyone to start a web site or service or to give me or anyone else access to it at all, much less for free.
I'm just making the very narrow point that when a company chooses to do all of that, and manages to make enough money to build a plush corporate headquarters on some of the most expensive real estate on the planet and pay its executives millions or even tens or hundreds of millions of dollars, then starts crying about not making enough money, that's self-evident bullshit.
If anybody's acting"entitled" in that scenario, it's the greedy corporate weasels who spend billions on their own privilege, then expect us to cover their asses when they come up short.
I was thinking about this the other day. We might have to move to a whitelist federation model with invite-only instances at some point.
It's a trade off that we'll probably have to take unless we want to deanonymize the internet.
And that is how you get singular point of view echo chamber.
Most of the internet is made up of echo chambers now even though anyone and everyone can access a majority of it. I don't think being selective in who we allow into communities worsens the pre-existing echo chamber issue. If anything it may help to be more selective. It can sometimes be impossible to tell the difference between trolls, bots, and real people, so I feel like we assume every person we disagree with is a troll or bot. The issue with that is that we may be outright dismissing real opinions. In theory, everyone in a selective community is a real person who is expressing their true thoughts and feelings.
I don't think that's a perfect system anyway though, spammers could create a massive tree of fake accounts and just only use a small proportion of them for spam
Use a number of compromised user accounts to set this up and it becomes a nightmare
Instead of being this gen's September 1993, I feel like the changes being sped up by the introduction of generative models are finally forcing us into October 1993. As in: they're reverting some aspects of the internet to how they used to be.
That spells tragedy of the commons for those companies. They ruining themselves will probably have a mixed impact on us [Internet users in general].