Show HN: Filter out engagement bait and politics on your X/Twitter feed

https://unbaited.danielpetho.com

by danielpetho • 2 years ago

71 106 2 years ago

unbaited.danielpetho.com

hi friends!

i'm pretty tired of engagement bait and all the political nonsense on my x/twitter feed.

i was curious if i could use an llm to filter out these type of content, so i prototyped a quick chrome extension.

it uses LLama 3.3 to analyze the tweet through https://groq.com/ (because they are super-super fast).

the extension is available in the chrome store, also there is a link to the repo.

- you can tweak the system prompt for the filtering - but you need your own API key from Groq (you can get one for free)

nomilk6• 2 years ago

I'm personally a huge Elon fan, but I know many who are not and have heard from multiple sources that they can't get him out of their feeds no matter how hard they try. If you tweak your current idea to simply remove all Elon-related content from the feed, that would be funny but may also be strangely profitable (people would probably buy it out of spite).

plaguuuuuu• 2 years ago

[flagged]

nomilk6• 2 years ago

Leaving X is one way. But there is an intersection in the venn diagram between those who find X valuable and those who dislike Elon's content.

ImJamal3• 2 years ago

You won't get messages from Elon, but you will sure get a lot of messages about Elon since he lives rent free in so many people's mind.

patchtopic• 2 years ago

[flagged]

blueflow• 2 years ago

The platform was not the problem, it was the people. People migrated to bluesky and fedi and now create these contents there.

anthk2• 2 years ago

Elon was one of the main enshittifiers. I even used to read Twitter without JS.

input_sh2• 2 years ago

If the platform wasn't the problem, nobody would've moved.

Closing down the API, charging for the checkmark, not displaying tweets to those not logged in, artificially boosting tweets by the owner itself etc etc.

xmodem2• 2 years ago

Switching to mastodon has been such a breath of fresh air. No algo-driven feed manipulating me to constantly check in means that I have a much healthier relationship with it. If I'm, say, on the metro I can use it to kill time for 5 minutes... and then put it down, and I don't feel compelled to pick it up.

bArray• 2 years ago

Be careful what air you breath in: "Twitter rival Mastodon rife with child-abuse material" [1] [2]. A lot of this was previously limited by X until a mass exodus to platforms such as Mastodon and BlueSky.

[1] https://www.washingtonpost.com/politics/2023/07/24/twitter-r...

[2] https://archive.is/SNYcK#selection-423.0-423.53

Kiro• 2 years ago

Every time I see a post from Mastodon it's always some hate and rage driven rant. Like "I can finally say what I want so f* this and that". Anecdotal of course but it doesn't really come off as less toxic.

yellow_lead• 2 years ago

Its impressive how fast this is. I don't use twitter anymore (for the same reason as your use case), but nice job!

wkat42423• 2 years ago

It's groq, they have amazing custom built hardware.

danielpetho15• 2 years ago

yes groq is really amazing.

there is another player i've found when making this -> https://inference.cerebras.ai/

never tried their api tho

eddieh• 2 years ago

It was much easier and healthier for me to just leave Twitter (never gonna call it the other name). In fact, I’ve left nearly all of social media. It would be nice to get away from all algorithmic content feeds. Maybe someday.

nomilk6• 2 years ago

Social media apps have downsides, but I find the algorithmic short videos on facebook ("reels") quite incredible. The algo seems to suggest mostly science; niches I would never have known about, let alone had an active interest in, had the algo not suggested them.

I suspect experiences using social media apps differ wildly from person to person.

enaaem• 2 years ago

X is by far the least fun social media app. I tried it and I never got the appeal. Just stick to insta for lighthearted content.

vintermann2• 2 years ago

I had an amazing experience with Facebook shorts! What happened was I...

I had an amazing... (hits the close button)

BeFlatXIII• 2 years ago

I find the algorithmic short videos on facebook ("reels") quite incredible

Mine discovered that I go wild for horse videos. The fewer humans on screen, the better.

bjornsing2• 2 years ago

It pains me but I’m leaning in this direction too. I found the idea of a digital town square with a commitment to maximum truth appealing, but seeing what Twitter has become it’s hard to not feel this was naive of me.

To me the big blow was seeing the response to what’s happening in Gaza and what narratives people and algorithms in combination end up promoting. The thoughtful, balanced, humanistic view gets approximately zero traction, while completely untruthful propaganda (on both sides) has enormous reach.

Maybe it’s an insurmountable problem. Human defense mechanisms in combination with algorithms will always push people to tribalism and cheering for atrocities. I hope not, but seems like it.

I guess you could take the OPs approach of filtering out all the propaganda and keep contributing. But then you are effectively working for a propaganda machine free of charge, helping create value that will draw others in to be subjected to the propaganda.

soco2• 2 years ago

"completely untruthful propaganda" honest question: how are you able to discern that?

alias_neo• 2 years ago

I only ever used Twitter for news because it was were all of the big names were;, but I stopped using it entirely when it took a massive dive after the recent sale. I checked back a couple of days ago, and top of my feed was some BS take on a subject (I forget what), and _every_ _single_ response was from a blue-tick agreeing with it, I immediately knew I can close it and not come back unless I want to click through to a specific tweet for whatever reason.

jamesrcole• 2 years ago

I think this is a glimpse of the future. I can imagine ever-greater amounts of information overload, and AI used everywhere to filter it to manageable levels.

freehorse2• 2 years ago

This sounds like an extreme waste of resources in all sides.

bryant• 2 years ago

Extreme is right; I can only imagine the waste of power. It's probably exponentially worse than the waste of gas by postal services for delivering junk mail.

Except I'm not sure there's anything that can be done about it in the US because of first amendment rights.

input_sh2• 2 years ago

LLMs in a nutshell.

Also see: people using them to write artificial garbage and then readers using them to summarise the said garbage.

wkat42423• 2 years ago

And on the other side AI being used to create more of it and to find ways to bypass the filters.

anthk2• 2 years ago

Just leave out Xitter. Read blogs over RSS and gopher phlogs (SDF, bongusta...)

Also, Usenet and Dove/Fidonet (you can get them over NNTP news://cvs.synchro.net:119) have more polite discussions on politics.

palmfacehn4• 2 years ago

90% of my feed is just AI generated art. The mute button seemed to work on the baiters.

tomalbrc• 2 years ago

*AI generated pictures

dewey• 2 years ago

If you have to fight this much to use a platform...why bother?

danielpetho15• 2 years ago

the network effect is still strong.

it feels like a huge chunk of (recent/real-time) tech/design discussion happens there. but could be just me. i'm still warming up on bluesky/threads.

pwdisswordfishz• 2 years ago

Why do you insist on perpetuating it?

wkat42423• 2 years ago

Um yeah good idea in principle but for me if I don't want to see the bad content it's better to just not look at it. The hate is everywhere, even on positive posts in the comments.

But good idea yes.

danielpetho15• 2 years ago

i agree. but sometimes my lizard brain just can't resist the temptation and i will stop to read the tweet/start a video. and the algorithm already could think that i'm interested in this type of content

gigatexal• 2 years ago

Would instantly use it if I could also have it filter Elon’s tweets and his fans and followers.

danielpetho15• 2 years ago

you might be able to craft a system prompt eg.: filter out anything that mentions or even slightly related to elon musk, his companies, etc.

obviously it's never going to be perfect tho

but your best bet is still blocking/muting people then

DantesKite• 2 years ago

Such a great demonstration of the concept.

I think it’s inevitable that we’ll start to see more sophisticated ways of organizing our social media feeds.

I don’t think it has to be this binary decision where we either abandon social media altogether or expose ourselves to the most emotionally draining content possible. There’s likely many different unexplored metas as it were.

I often joke that we should have a marketplace of algorithms we can subscribe to, where the sentiment “slider bar” can go from Hello Kitty Island Adventure positivity to 4Chan LiveLeak nihilism, if you so choose.

danielpetho15• 2 years ago

yeah some kind of real-time tweaking would be also nice. sometimes i'm in the mood for topics i'm usually not following, but i would go back to my "default" space after a while.

the problem imo is that there is absolutely zero control on most platforms.

on x there is a button called "i'm not interested in this tweet" but obviously it doesn't do anything meaningful

MattDaEskimo2• 2 years ago

This is what the algorithm & tools of the platform is supposed to do for you.

It's also what makes you valuable as a free consumer.

If you want lumber, don't buy a house and strip it

beAbU• 2 years ago

I've found this [1] to also work really well to clean up the feed.

1: https://help.x.com/en/managing-your-account/how-to-deactivat...

buran77• 2 years ago

I went that route for my account which I wasn't using anyway but only because I realized it's not "my account" and my control over it is way too limited.

I logged in after many years of inactivity only to realize that despite only having a few friends, my feed was exclusively Musk and Tesla stuff. No amount of "don't show me this" helped. On one hand I found it exceptionally pathetic that any person would need to stroke their own ego to this degree at the expense of everyone else. But worse, it's clear that Twitter/X/Musk control my feed more than I do so the only way to win the game is to not play it.

thih92• 2 years ago

The link leads to a Twitter/X support article for “How to deactivate your account”.

sphars• 2 years ago

That's the joke...

insin• 2 years ago

i'm pretty tired of engagement bait and all the political nonsense on my x/twitter feed

Getting rid of "For you" entirely and removing Retweets from the chronological timeline (default configuration for [1]) gets you 95% of the way there - you'll only get engagement bait and political nonsense if the people you choose to follow are the ones actively doing it, in which case…

[1] https://jbscript.dev/control-panel-for-twitter

danielpetho15• 2 years ago

oh wow, this looks promising. thx!

ksec• 2 years ago

Yes. I dont even use "For you". I dont even "follow" most people, just put them into a list and visit that list only. In hind sight I have been using X / Twitter like RSS for a very long time. I guess that is because coming from RSS and I dont know how Twitter work at first and I first thought why do I have all these random people on my feeds.

I have lists for Software, Hardware, Politics, VCs, Economy, Art, and some other wired stuff.

You can ignore 99% of Spam, bait etc and only focus on the signal.

yomismoaqui• 2 years ago

Already implemented something similar but using Gemini Flash 1.5

https://twitter.cercaapp.com

danielpetho15• 2 years ago

neat!

yes it's the same idea, tho for this one you need your own API key, which can be a bummer for some.

strajk• 2 years ago

Nice! I'm glad I was not the only one frustrated by these and I actually made sth similar just this weekend, also using Groq cause it's super fast as u said. (but haven't published it cause I'm always frustrated about that part of sideprojects :D) https://x.com/Straaajk/status/1875492276715315405

danielpetho15• 2 years ago

super cool! i like yours better tbh as it looks much more granular in terms of categorizing

re publishing—just do it! this project is also a rough mess, only a quick experiment, so i doubt anybody will care if it fails sometimes / not perfect, code is a mess etc.

haunter• 2 years ago

I don't have to because I just use the "following" tab? I only see people I follow. Really don't get the point of this service

danielpetho15• 2 years ago

i like the for you page since i can discover fresh/new work from others. otherwise how would i get to the point of following someone? (excluding when you find the person's account on an external site)

but i feel you, the following tab is definitely a healthier/more controllable space

geerlingguy• 2 years ago

For years before the algorithm-generated pages were defaulted, you would find new accounts organically—through retweets and conversations.

I still do it that way, better to do a (very) slow roll and build up a network slowly than to follow the accounts Twitter's algorithm thinks I should follow (IMHO).

andrewla4• 2 years ago

Your "following" feed contains content liked or retweeted/replied to by people you follow. At least, it used to -- since likes went private I'm not sure that you see this any more.

vanrohan• 2 years ago

I'm also on a mission to clean the "For You" feed. I tried using local LLMs to do this real-time classification, but it's currently just too slow.

Another way to reduce the spam, is to remove bot followers from your account, I believe these bots use "likes" (which are hidden) to boost content for the botnet owners. Most of these bots are easy to spot, 0 posts, and very bad follower/following ratios. I built this Chrome Extension for bot removal automation: https://chromewebstore.google.com/detail/x-bot-remover/aohkh...

It would be way better if this was just done by X themselves, but why not try.

danielpetho15• 2 years ago

yeah, something local (and free) would be much better. i'm not even sure how expensive could this be if it would run all the time...

re bot removal: thanks for it, will give a it a try!

russdill2• 2 years ago

It'd be nice if x would let you do what bluesky does, let you write your own algorithms and create your own feeds.

danielpetho15• 2 years ago

ah maybe i'm living under the rock, but how you could do such thing for bluesky?

my feed is pretty boring there:d

pluc3• 2 years ago

If you don't want engagement bait or politics on Twitter.. why are you on Twitter? RSS is better to keep up to date on news, and if none of your friends are on Mastodon, get new friends.

bearjaws• 2 years ago

I think Twitter has two core users

1. People who want to debate / react to things / politics / just get angry apparently.

2. People who are like a town crier from times past, they want to be the first to know some event has happened and then go to their group chats & other social media to post about it.

danielpetho15• 2 years ago

i disagree, or at least i don't consider myself to either of these groups.

i think there is still a large enough group which is there to share work / projects

MattDaEskimo2• 2 years ago

3. Those who just don't care about the sociological trends and impact of using, and therefore promoting Twitter

andrewla4• 2 years ago

Sorry, ignorant question -- how does one us RSS to keep up to date on news?

With Twitter, I can see content from people I follow and from content referenced or highlighted by people I follow. People in this case can also include news organizations or other professional journalistic content.

In addition there is the algorithmically generated garbage feed stuff that is mostly useful for seeing (potentially) interesting content that I missed on the main feed, but also contains a ton of content from people I did not follow and that people I do follow did not highlight or reference. Presumably this project attempts to reduce the garbage-ey ness of this feed, which I would appreciate.

pluc3• 2 years ago

For the next month, every time you find something interesting on Twitter, go to the source. Look for their RSS feed - if they don't have one, ask them to work on implementing one both via Twitter and via their contact form.

I don't know if it's still the case, but there used to be RSS feeds for Twitter accounts too.

akopkesheshyan• 2 years ago

Completely agree. No need to over engineer problem. Just leave the network

Havoc• 2 years ago

Prompt used seems to be here:

https://github.com/danielpetho/unbaited/blob/main/extension/...

Seems like a reasonable idea. I have doubts about an LLM being able to reliably detect when a tweet was made to *deliberately* trigger emotions. That’s setting the bar quite high on llm working out intent

danielpetho15• 2 years ago

100% agree unfortunately, haha

the default system prompt is quite weak, and could be much more specific / better.

also, even as a "human" can't decide sometimes what is a bait...

bentt• 2 years ago

Too many replies are missing the point. This isn't about whether there are other ways to do this, or if X is good/bad. This is about using a local AI model to curate content we want to avoid/see. This is a big area of interest and I'm happy to see something on HN about it!

ikanreed• 2 years ago

But, of course, it would be better if we could generalize and let users describe in conversational language the specific things they don't want to see.

itslennysfault• 2 years ago

It's not a local AI model. It's using a groq.com API, but your point about people missing the point is still a good point.

danielpetho15• 2 years ago

yes that's the main idea.

i mean even llms wouldn't be necessary (this is just a possible direction), but just give me more control on my own feed

derivagral• 2 years ago

Cool idea! I had something similar for using LLMs as an intermediary not for spam but for "boring" local news matching to your profile. Court stuff, town meetings on youtube, that kind of thing.

danielpetho15• 2 years ago

sounds interesting! tho that would be rather summarizing content i assume?

andy_ppp• 2 years ago

I want this for YouTube videos as well that can summarise the content and just take me to the things I would find most interesting in the video, almost like auto chapters that skip all the “and later we’ll be discussing really interesting thing X if you keep listening” filler. It would be great to filter all the noise out and create highlights package automatically that was 10% of the video length that can be watched separately.

andrewla4• 2 years ago

Tangential, but I think I speak for many when I say that we no longer need to specify "X" as a name for twitter -- just call it twitter and tweets and ignore the abysmal rebrand until the day that it gets reverted.

j45• 2 years ago

Filtering out is a nice feature.

Highlighting each piece as such and teaching as what about it is bait, etc would make people stronger and more aware.

pjmlp• 2 years ago

I have been ramping down my use until I collect the info I need to follow specific people elsewhere, then I am out as well.

ryan_lane• 2 years ago

Why do you use twitter if you want to log into a completely blank feed every time you use it?

Show HN: Filter out engagement bait and politics on your X/Twitter feed

Related Stories