I've been thinking a lot about the Fediverse ALT issue.

Some people are annoyed by posts without Alttext, & others get reminded¹ to add it.

The core question is: How can we improve accessibility?

Proposal: ☑️ Add a user filter to hide media posts without AltTag ☑️ Reduced engagement on hidden posts would encourage adding Alt text ☑️ People who need accessibility wouldn't have to encounter unlabeled media

If this gets traction, I'll open a Mastodon GitHub issue (maybe on others too?).

¹ https://mastodon.social/@madeindex/113996311493021102

all 31 comments

sorted by: hot top controversial new old

[–] nasi_goreng@lemmy.zip 5 points 1 day ago (1 children)

Some software does not support alt-text, so people write the text on the post itself or comment.

[–] Snoopy@tarte.nuage-libre.fr 2 points 1 day ago* (last edited 1 day ago) (1 children)

Well that's what i did on lemmy in the begginning.

So a middle ground is need or maybe we should work on a fediverse accessibility charter ? Something that set some rules for the whole fediverse :

new software
3 years software
various disabilities use case
standarized colors scheme and font. So it would be easier to update them.

[–] nasi_goreng@lemmy.zip 2 points 1 day ago

Some fedi software are esoteric, like Misskey have Misskey flavoured markdown (example), even Mastodon cannot display the feature. There are fedi software that can be accessed via console, zero image displayed. Some others have non-conventional design that caters to specific use, basically not even for mainstream people, so they don't even follow any accessibility rules.

[–] lambisio@feddit.cl 11 points 1 day ago (1 children)

Why not start with autotagging image posts with no alt text with something like Mastodon's #Alt4Me? It summons the human element to help submit the data, instead of depending on AIs that we all know the stupidity and evil they do.

[–] Snoopy@tarte.nuage-libre.fr 4 points 1 day ago* (last edited 1 day ago) (1 children)

That's a good start but i'm worried that most of us are lazy. They won't change their habits unless you enforce it.

I wouldn't condemn AI in this case. For example most of captioned video come from AI. Yes there is typo, lenghty text, missing text, nonsensical text but they do a fairly good job. No one have the time to create subtitle, and engaging professional may be costly.

Without AI, i wouldn't be able to watch and understand videos, podcasts nor get a transcript.

[–] lambisio@feddit.cl 1 points 1 day ago* (last edited 1 day ago) (1 children)

No one have the time to create subtitle, and engaging professional may be costly.

Bitch I lived through the anime fansub times of the early 00s. Sometimes the fans had the subs ready before the episode came out, and they were top notch quality, even with localization considerations. And they were doing it for free (if still for the cred). AI can only ever hope to have that sort of dedication.

Like, really, what kind of brainrot do you have? We've had internationalized captions and content decades before we had AI.

[–] Snoopy@tarte.nuage-libre.fr 2 points 1 day ago

TL; DR

However, not every videos are captioned. You can't match the scale of created content.

I have a nuanced opinion on AI. They are part of corpothieve, tech bro that destroy our environement and promote fascism or occidental visio on the world. On the other hand, it is also a tool that can help deaf people in their daily life and scientific research.

Brainrot

I didn't insult you. I shared my deaf experience. We come from different background...was it needed ? Why ?

I was also there in 00s. Yes, my mom also created subtitle for some french movies. I also created some subtitle for video, translated them...Yes, there was fansub, with a huge dedicated communities. They are awesome and they played a keypart on sharing other culture. Thank you to you all and them. 😊

the scale of uncaptionned videos

However, not every videos are captioned.

That's the point you misunderstood : the scale of uncaptionned video and the deadline. Given the huge amount of videos, a fansub can't match the scale of video content created every days. That's where AI can save my day. It does help me.

If i watch something that doesn't have a fansub, community : 0 captions. So i have to create a request in your communities. some people may accept, some people may reject it. At best i have to wait some days or months. It depend on our free time since we are doing voluntary work.

You omited podcasts. If i try any french webradio : 0 transcript. Some people used AI to get a transcript for their podcast. They reread and corrected it. It helped them getting a transcript quickly and i benefit from it.

my deaf experience

I studied space design. Teachers shared lot videos on architecture, those videos weren't captioned, so as a student i poured lot effort to understand what they said in those videos...At the end of day, i was exhausted. I poured too much effort and ended up in burn out.

Later, i followed a course to become a farmer. It was during the Covid period. I had to wait 6 months to get sign language interpreters. Not only i lost half a year battling to get sign language interpreters, but i also had to watch video on agroecology without manmade captions and participate to visio meeting...Luckily, there was some apps as Ava, google transcript and later Lokas (free software from framasoft. It use whysper) that use artificial intelligence. Teachers and students weared mask, i couldn't read on their lips. So how do you handle it ?

I can't imagine how i would deal it without those AI app. It would be hell and would have stopped my lesson because of burn out.

The french election in 2024

Another example. In 2024, the french president dissolved the national assembly. Election were upcoming in less a month. I battled very hard to get captionned videos, contacted lot people, joined various group, called deputies to get their video captioned for deaf people and translated in sign language. We were a team and only got two or three videos...

conclusion

I can use those AI app when :

no one is taking note on a collaborative pad
if interpreters aren't available.
if there is no caption

Lastly, some deaf friends told me they used AI to help them writting good sentence. Most of deaf people struggle with writting.

So, I have a nuanced opinion on AI. They are part of corpothieve, tech bro that destroy our environement and promote fascism or occidental visio on the world. On the other hand, it is also a tool that can help deaf people in their daily life and scientific research.

[–] beveradb@sh.itjust.works 18 points 2 days ago (3 children)

These days, it would probably be more effective to make it easy for instance operators hook up a local multi modal llm to the server to auto generate alt text for all images posted on their instance. I'd happily donate to cover the infrastructure costs for any instance owner who was doing that

[–] madeindex@lemmy.world 13 points 2 days ago* (last edited 2 days ago)

Definitely more effective than every disabled person etc. having to generate it! Have you seen the Mastodon image text to alt text feature? I guess they could simply expand on that?

[–] Cris_Citrus@piefed.zip 2 points 1 day ago (1 children)

While I understand the potential value of that, it is worth also acknowledging that ai will never understand the human, social, contextual meaning of things its providing alt text for, and theres a fair argument to be made that folks with disabilities deserve those things

Id welcome perspectives from folks with relevant disabilities who use or depend on alt text :)

[–] SlurpingPus@lemmy.world 1 points 1 day ago

‘iPhone Magnifier and Voice over’

I don't hear her complaining.

[–] lambisio@feddit.cl -1 points 1 day ago (2 children)

I thought we were anti AI...?

[–] SlurpingPus@lemmy.world 6 points 1 day ago

Take a look at how blind people can use phones to learn what's around them, and tell me afterwards that you're still against AI.

[–] beveradb@sh.itjust.works 2 points 1 day ago (1 children)

It's a polarised topic but doesn't need to be, IMO - I still see it as a tool, albeit a powerful one with lots of risks and drawbacks, but the cats out of the bag at this point so we may as well roll with it and make the most of the applications for good. Like with many other massive, rapid technical advancements of the past.

[–] lambisio@feddit.cl -3 points 1 day ago (2 children)

AI is quite unlike other "rapid technical advancements of the past" in that sense. It's so damaging to people, society and environment that there is currently no possibility that any use you make of it, "well-intentioned" or not, can improve things. Any "we might as well use it" s little more than joining the oppression.

[–] p03locke@lemmy.dbzer0.com 7 points 1 day ago

Imagine thinking that LLMs are so toxic that you'd think we're splitting the atom, a technology so polarizing that it became a security issue. Any yet, nuclear power is an incredible scientific achievement, and something we still use all over the place. But, it's also a technology that we still aren't fully utilizing 80 years later, because of fearmongers like you taking away any sense of nuance in the conversation, and letting blind absolutism govern your opinions.

[–] SlurpingPus@lemmy.world 4 points 1 day ago (1 children)

I replied to you with an example of AI recognizing things that the phone camera sees, to tell the blind user about them. That reply was before this comment of yours. I myself am also a person using auto-generated subtitles on YouTube, because my hearing isn't too good, especially for the non-native English language.

Yet you claim that none of these uses improve things. So you see less-able people as unworthy of improvements to their lives. Nice to know, because an opinion stemming from bigotry can be summarily dismissed.

[–] lambisio@feddit.cl -1 points 22 hours ago (1 children)

You are somehow interpreting me not seeing the good in AI as if it was the same as less-able people being unworthy of aid? Please, get off your high horse. I never said that. I simply say AI is not the way, or even a way. AI is the solution to an invented problem, being sold as such, when people say "only AI can cope with the scale", have you stopped to ask, where does the scale come from? And, for that matter, 85% of what people call "AI" is actually just remote operators in Kenya or India, so what is "scaling" is just oppressing more and more people to unworthy work conditions.

Oh well. You do you. Their goal is to get their victims to fight each other. I'm stopping here.

[–] SlurpingPus@lemmy.world 1 points 9 hours ago* (last edited 9 hours ago)

You are somehow interpreting me not seeing the good in AI as if it was the same as less-able people being unworthy of aid?

I provided examples of the good delivered specifically by AI for disabled people, you still continue to dismiss it. This means that either you're particularly dumb, pretend to be so, or are a bigot. Choose for yourself which one it is.

I simply say AI is not the way, or even a way. AI is the solution to an invented problem

Blind people not being able to see unless someone, or an AI, describes the surroundings for them, is an invented problem? You seem to be doubling down on either the bigotry or the idiocy.

But wait, since you say AI isn't the way, you surely have another solution in mind. You know you're free to advocate for that solution instead, without being an asshole toward disabled people.

when people say “only AI can cope with the scale”, have you stopped to ask, where does the scale come from?

That video is from 2020. Pray tell, were you also protesting against AI in 2020, or did you finger your ass instead until it's become fashionable to hate ChatGPT, so you could blindly transfer that hate onto Apple too? Have you ever spent a second to learn that the Neural Engine accelerator for AI functionality was included in iPhones since 2017, or did you just pull your ideas about 'AI scale' out of your asshole? Do you even understand what it means when AI processing is done locally on end-user devices, or did three buzzwords about AI hate block the entirety of your feeble reasoning ability?

And, for that matter, 85% of what people call “AI” is actually just remote operators in Kenya or India

Or really, please feel free to provide any semblance of proof that Apple's AI is done by people in Kenya, India or wherever, despite the Neural Engine chip. Be sure especially to highlight how the poor overworked people are able to do sub-second responses to millions of queries every day, with no change in the cadence of quality of the responses.

[–] northernlights@lemmy.today 6 points 1 day ago

Add a little input box after clicking submit when things like alt text are missing? Seems like an easy problem.

[–] j4k3@lemmy.world 6 points 2 days ago

OCR tool+ to autogen a suggested alt text. The path of least resistance needs to be lowered.

Alternatively, inverting the paradigm is likely to cause less issues and push back. Add the automated tool the the end user in need of the version. This obviously creates the issue of data quality and trust, but for the smaller group. What if there was a reply field silently posted to everyone's notifications feed indicating anonymous instances of the tool being used to fill in the gaps for alt text? The message would need to be opt out or carefully presented. Perhaps it could be possible to modify the post itself via the tool? Better yet, make the alt text field a Wikipedia style affair anyone with an account can edit, but with a lock available to the OP. That would create much more healthy awareness of the need for alt text, as people posting the content will see the places where gaps are filled by an automated tool. It gives them the chance to edit. This does little to initially improve the experience of the most active alt text users, but it creates a strong cultural shift in awareness that should improve the situation greatly in the long term IMO.

[–] Snoopy@tarte.nuage-libre.fr 4 points 2 days ago* (last edited 2 days ago) (2 children)

A simple one, i believe that softwares must enforce them rather letting users doing it.

Here is some ideas :

refuse "image post" without alt text.
when you upload picture, you must provide their alt text, if there is no alt text, the picture will be deleted.
hide user post based on alt text and remove post score if the alt text is bad.
deactivate crosspost on posts who don't have alt text

It maybe harsh but i believe that's the only way to reach accessibility.

Edit :

alt text autogen + a reminder bot will help users
The app fedilab (mastodon) has some good rules on post with alt text.
collaborative alt text.

[–] forestbeasts@pawb.social 7 points 1 day ago (1 children)

That's a really good way to end up with fake meaningless "alt text" that's only put there to get around the restrictions.

Caring about meaningful image descriptions is a cultural thing.

-- Frost

[–] Draconic_NEO@lemmy.world 1 points 1 day ago

I agree, I've already seen people on Mastodon doing this. This isn't the solution.

[–] lambisio@feddit.cl 5 points 1 day ago (1 children)

refuse “image post” without alt text.

Mostly* works, but increases significantly the barrier of entry to engage in "conversational" / "collquial" fediversing, and subjects the largest groups of people to the limitations of their tooling.

when you upload picture, you must provide their alt text, if there is no alt text, the picture will be deleted.

I assume this is for when you attach a picture to an otherwise text / link post? In that case, I think this is a very good path, yes, since in this ase the user who is adding the picture is already engaging in the extra work of getting it.

hide user post based on alt text and remove post score if the alt text is bad.

No CCP style shit please, we already have enough of that with Piefed.

Adding posts with no alt text to a predefined category or tag (such as Mastodon's #Alt4Me) sounds like a reasonable alternative.

[–] Snoopy@tarte.nuage-libre.fr 2 points 1 day ago* (last edited 1 day ago)

Adding posts with no alt text to a predefined category or tag (such as Mastodon’s #Alt4Me) sounds like a reasonable alternative.

Yes you are right. :)

No CCP style shit please, we already have enough of that with Piefed

I don't see why we should support content without alt text. There is people with various disability

I'm offering to void the post visibility :

the post won't receive upvote, so it won't reach the top of your timeline
user won't be able to crosspost them.

I'm deaf and i think we should all do an effort to make the web accessible. Everyday, i have to adapt to your world.

People can give a small fraction of their time to improve accessibility. But you are right it maybe too harsh, we should find a middle ground that invite users making the web a place place rather them punishing them.

Long explaination on piefed score

There is pro and cons using lemmy or piefed. Both have a different stance on moderation and offer a different experience.

Lemmy doesn't check downvote or users with bad reputation. How are you able to act with toxic users ? For example one downvoting a lot and the other one that post terrible thing thus get lot downvote ? Is this good for your community ? I don't think you will enjoy interacting with them.

Piefed score was requested by most admins and mods. It help us creating good community, our main job is creating a place where people enjoy sharing their experience. There are 2 scores :

attitude : it calculate the ratio of downvote/upvote. How do you react when people have lot negativity ? Most of us are around 70%. If you downvote a lot, that's not a good behaviour. There are few users or bots that downvote a lot. their attitude score is around 20% something like that, it is low. It removes the ability to downvote until you upvote and reach a threshold. So it invite user to use other tools (filter) to improve their timeline instead of voting.
reputation : that's the upvote you receive. Posting meme don't boost your reputation. Why ? Because of karma farming. Let's say i post terrible things, and i receive lot downvote. Meanwhile, i post fun meme and get lot upvotes...

So it just give us a general idea on users and improve community ambiance.

Futhermore, you can't just take the scoring system alone. Those features work together :

mods can remove downvote per community. I removed them in my communities.
filters : you can filter keywords, communities, instances and users.
report. It is more efficient, i prefer it over the automod that work well.

[–] Kolanaki@pawb.social 4 points 2 days ago* (last edited 2 days ago) (1 children)

There is already a not-hidden field presented when making a post to fill in alt-text on Lemmy, but I wonder how many users know its purpose. It assumes everyone knows what it is. It would be helpful if it had a short explination next to the input field, with a link to a larger explination and why it should be used.

And for images that are just screenshots of tweets or are otherwise just text, maybe some kind of image to text process can be done automatically to fill the alt-text out. 🤷‍♂️

[–] madeindex@lemmy.world 3 points 2 days ago (1 children)

I guess even a questionmark (with a link to a popular website explaining it) next to the alt-field would suffice.

Mastodon actually already has that, but manually! :)

[–] frischkaesbagett@feddit.org 5 points 2 days ago* (last edited 2 days ago) (1 children)

I created a github issue for alt Text warn before post and the developer immediatly started to work and it seems like he improved it really fast: https://github.com/LemmyNet/lemmy-ui/pull/4021

10/10 can recommend would do it again

Edit: added rating

[–] madeindex@lemmy.world 2 points 2 days ago

wow that is fast!!! Mastodon is definitely slower in this particular case! Somebody sent me a similar ticket from 2024 ;)