Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

https://github.com/openai/whisper/discussions/2608

by edent • 1 year ago

568 340 1 year ago

github.com

GaggiX• 1 year ago

Whisper frequently generates random credits. I guess they didn't curate the dataset much at the time.

sivers• 1 year ago

to save you a lookup:

The Arabic text "رجمة نانسي قنقر" translates to English as: "Nancy Qanqar's translation" or "Translation by Nancy Qanqar"

"رجمة" means "translation" and "نانسي قنقر" is the name "Nancy Qanqar"

aprilthird20212• 1 year ago

And it seems to be because the training data is largely unofficial subtitles from movies. Which often have a string like "Translated by X" at the end of the movie which is often silent while credits roll.

iqfareez• 1 year ago

make sense..

rob743• 1 year ago

Looks like they used more official sources for German - there, silence is apparently hallucinated as "Untertitelung des ZDF für funk, 2017" according to one of the comments on the issue. Which makes sense, as the public broadcasters' "Mediathek" is probably the largest freely available resource of subtitled videos in Germany. I wonder if the ZDF gave its approval for it being used for LLM training though?

4gotunameagain2• 1 year ago

I'm sure they totally did not pirate the audio of said movies.

mormegil• 1 year ago

In Czech, Whisper usually transcribes music as "Titulky vytvořil JohnyX" ("subtitles made by JohnyX") for the same reason.

actionfromafar2• 1 year ago

Haha, trained on torrented movies! :-D

The MPA must be so proud.

beshrkayali• 1 year ago

You've got a little typo, it's not "رجمة", it's "ترجمة" that means translation, the ت at the beginning is missing.

dandiep• 1 year ago

Whisper is unusable IMO because of the hallucinations. Widely documented. Removing silence from audio clips helps, but even then it will auto correct grammar, translating bilingual speech, etc. Improved in the latest audio models but not solved [1]

1. https://news.ycombinator.com/item?id=43427376

eric-burel• 1 year ago

That's the problem with raws large models, it should always be coupled with satellite small models and logic. It's (probably) easier to detect hallucinations using a traditional ML/DL model that can catch mismatches (it's easy to build a synthetic dataset for this) than transcribing. And the simplest piece of code can detect a silence and that it should match no text.

ilyakaminsky2• 1 year ago

I wouldn't describe it as "unusable" so much as needing to understand its constraints and how to work around them. I built a business on top of Whisper [1] and one of the early key insights was to implement a good voice activity detection (VAD) model in order to reduce Whisper's hallucinations on silence.

[1] https://speechischeap.com

poly2it• 1 year ago

How does this make a profit? Whisper should be $0.006 to $0.010 per minute, but you rate less than $0.001? Do you 10x the audio?

horseradish7k2• 1 year ago

well, auto correcting grammar happens in normal subtitles too... "Why don't subtitles match dubbing?" by Tom Scott: https://youtu.be/pU9sHwNKc2c

GodelNumbering• 1 year ago

Interesting that this happens even on large v3. I had once done a deep dive into STT and Whisper Large was the only model that could correctly transcribe Yann LeCun (it was a Lex Friedman podcast), ever since I held the belief that it was the best STT model, this was over 2 years ago

dlcarrier• 1 year ago

Classic overfitting

It's the LLM equivalent of thinking that an out-of-office reply is the translation: https://www.theguardian.com/theguardian/2008/nov/01/5

stingraycharles3• 1 year ago

How is this overfitting, rather than a data quality / classification issue?

hsn915• 1 year ago

ُThe Arabic text is the translator's self credit

"Translated by Nancy Qanfar"

maxbond5• 1 year ago

It is a data quality issue which caused the model to overfit.

mort962• 1 year ago

Isn't overfitting just when the model picks up on an unintended pattern in the training data? Isn't that precisely what this is?

bGl2YW5j• 1 year ago

If the model was able to generalise, you’d expect it to output something like “[silence]” or “…”, in response to silence.

Instead, it reverted to what it has seen before (in the training data), hence the overfit.

RamblingCTO4• 12 months ago

As I didn't see one correct definition of overfitting:

overfitting means that the model is too closely aligned to the test data, picked up noise and does not generalize well to *new, unseen* data. think students that learn to reproduce questions and their answers for a test instead of learning concepts and to transfer knowledge to new questions that include the same concepts.

while this sounds like overfitting, I'd just say it's garbage in, garbage out; wrong classification. the training data is shit and didn't have (enough) correct examples to learn from.

Lucasoato• 1 year ago

In Italian as well there are random hallucination when parsing silence, something like: “Thank you for watching”, “Subtitles by…”

userbinator• 1 year ago

I wouldn't be surprised if "like share and subscribe" also shows up at some point.

Muromec• 1 year ago

"наша зброя в цей момент -- вподобайка і комент"

madcaptenor2• 1 year ago

In the comments to that Github issue, by alentodorov:

in romanian, i’ve noticed multiple instances where the transcripts ends with “nu uitati sa da-ti like si subscribe” which, as you might easily infer , translates to “don’t forget to like and subscribe”.

tornikeo• 1 year ago

Garbage in, garbage out. If the training dataset (accidentally) paired silence (`X_train`) with `رجمة نانسي قنقر` tokens (`y_pred`), then any silence will always be translated to that. Fortunately, this particular problem is easy to fix--just detect and remove silent parts before API call. This also has a side benefit of saving you money on transcription.

Zacharias0302• 1 year ago

and saving money on litigation.

Hobadee• 1 year ago

Little did you all know, this is just being mechanical turked by Nancy Qunqar.

Way to go Nancy! Keep up the good work, ya crazy bastard!

whamlastxmas2• 1 year ago

Is this spam? That name only shows as an instagram account and this thread. If you pay for insta followers is this how they get them now? Haha

DAlperin• 1 year ago

That’s the name in the Arabic text hallucinated by the model :)

vanschelven2• 1 year ago

I wonder if hallucinated copyright claims (esp. like the ZDF one at the bottom of the OP) will be introduced as evidence in one of the court cases against "big AI"

staplers• 1 year ago

It already has been and meta won the lawsuit because corporations are sacrosanct.

vanschelven2• 1 year ago

Do you mean that specifically a hulucibated text "copyright by not-meta" made it into evidence? Or are you talking about copyright generally?

berkes6• 1 year ago

Evidence against what?

"Big AI" is transparent and open about the fact they use all sorts of copyrighted material to train the data. How would "we see an exact chunk of text from our copyrighted material" add to that?

pbmonster• 1 year ago

It appears they have not been training on the official studio subtitle files, but on community transcriptions/translations commonly distributed with torrents.

So not only are they training on copyrighted material, but they didn't even pay for it once, and then they didn't even do minimal data cleaning before training. Which, by the way, is the type of cleaning their LLMs could have done.

sofixa2• 1 year ago

Their main defence is that it's fair use because it's transformative (like a human reading a book, getting inspired, and writing something of their own) and not a copypaste illegal distribution (like a human scanning that book and selling it themselves).

Having models hallucinate copyright notices shows that some content is being copypasted as is, which kind of goes against the transformative argument.

(Note: I think that trying to litigate AI with current copyright laws is weird. They were created before LLMs were even imagined, so of course they can't handle them clearly. New laws are needed around this, not trying to bend over backwards to think about what a lawmarker a century ago would have thought about how transformative a thing they couldn't have imagined is.)

cyp06332• 1 year ago

The same happens with whisper-large-v3 on Chinese transcription: silence is transcribed to something like "please upvote, share and favourite this video". I suspect they trained the model on some random YouTube video without carefully picking really useful data.

st_goliath• 1 year ago

That's interesting, the few times I tried playing with whisper, I had the impression that YouTube style videos or random cellphone videos was something it did particularly bad with (compared to movies). My guess at the time was that most of the training material might be sub titles and raw screen plays.

The videos I tried to transcribe were also Mandarin Chinese, using whisper-large-v3. Besides the usual complaints that it would phonetically "mishear" things and generate nonsense, it was still surprisingly good, compared to other software I played around with.

That said, it would often invent names for the speakers and prefix their lines, or randomly switch between simplified and traditional Chinese. For the videos I tested, intermittent silence would often result in repeating the last line several times, or occasionally, it would insert direction cues (in English for some reason). I've never seen credits or anything like that.

In one video I transcribed, somebody had a cold and was sniffling. Whisper decided the person was crying (transcribed as "* crying *", a cough was turned into "* door closing *"). It then transcribed the next line as something quite unfriendly. It didn't do that anymore after I cut the sniffling out (but then the output switched back to traditional Chinese again).

isoprophlex2• 1 year ago

Indeed, with another model I would get persistent transcriptions of silent parts into 'Thanks for watching!' or '[MUSIC]'. Pretty dumb that this failure mode wasn't caught in some QA process, and there are now multiple transcription models suffering from the same issue. Having silent parts in your input audio seems like it should be a very common occurrence...

rollcat2• 1 year ago

When I was taught mathematics, the zero value was always considered the most important edge case. You prove something for N=0 (or N=1), then for N=M+1.

It's even more important in audio DSP: processing near-zeroes can end up being extremely CPU intensive, look up denormal/subnormal floats.

wahnfrieden5• 1 year ago

whisper MUST be combined with silence detection / VAD

ttflee• 1 year ago

In Chinese, it always added something like "For study/research purpose only. Please delete after 48 hours." This is what those volunteers added in subtitles of (pirated) movies/shows.

cyp06332• 1 year ago

That is not the case here - I never encountered this with whisper-large-v3 or similar ASR models. Part of the reason, I guess, is that those subs are burnt into the movie, which makes them hard to extract. Standalone subs need the corresponding video resource to match the audio and text. So nothing is better than YouTube videos which are already aligned.

codedokode10• 1 year ago

Fair, if AI companies are allowed to download pirated content for "learning", why ordinary people cannot.

kgeist• 1 year ago

Interesting, in Russian, it often ends with "Subtitles by %some_username%"

xigoi2• 1 year ago

Pray, Mr. Babbage, if you put into the machine wrong figures, will the right answers come out?

madcaptenor2• 1 year ago

I am not able rightly to apprehend the kind of confusion of ideas that could provoke such a question.

mmcwilliams• 1 year ago

Similar in the English model. Pretty clear they trained on YouTube videos where creators will put that in otherwise silent sections to ensure it shows up for people with CC on.

probably_wrong• 1 year ago

The number one hallucination in my transcriptions was "Subtitles by the Amara.org community".

indrora• 1 year ago

When YouTube began building automatic transcriptions for captions, it regularly flagged any noise or music -- typically industrial noise -- with "[foreign]"

If it couldn't understand it, it was "foreign" for the longest time.

stndef• 1 year ago

Yeah, I can confirm seeing that a fair bit specifically during non-verbal parts of videos when someone is using a tool.

the_af2• 1 year ago

Hey, Netflix occasionally still puts in its English subtitles "[foreign music]", it always cracks me up.

tonyhart7• 1 year ago

lmao

philipwhiuk• 1 year ago

I suspect they trained the model on some random YouTube video without carefully picking really useful data.

They trained the model on every YouTube video they could, and hoped the aggregate was useful data.

danirod• 1 year ago

This is totally happening with other models too, at least with Spanish. Many transcriptions will end with something that roughly translates to "Thanks for watching!" even if it's never present in the original audio.

PhasmaFelis• 1 year ago

This reminds me, some years ago as Google was expanding its translation service, someone tried translating text into and out of an obscure African language (don't recall which) and it always came out as weird Biblical-sounding semi-gibberish.

My revelation was that machine translation needs a corpus of bilingual documents to learn from, and if the language is sufficiently obscure, there may not be any bilingual documents except for the Bible, which missionaries have translated into just about every language on Earth.

horseradish7k2• 1 year ago

oh yeah this happens a lot on reddit on videos in foreign languages

sandspar2• 1 year ago

Neat, we finally know the answer! What is the sound of one hand clapping? Translation by Nancy Qunqar.

layer83• 1 year ago

I can clap with one hand (fingers on palm) and it produces a clapping sound.

boomlinde• 1 year ago

Your brain merely hallucinates a clapping sound as "Translation by Nancy Qunqar" enters your ears.

sandspar2• 12 months ago

Ah, so the sound of one hand clapping is: clapping! A little underwhelming, to be honest. You mean I climbed the Zhen Zi mountains and performed the Seven Labors to learn... this?

kristjank• 1 year ago

roses are red

violets are blue

unregistered hypercam 2

maxbond5• 1 year ago

Roses are red,

Silence is golden,

Translated by Nancy,

To copyright, we aren't beholden

arnejenssen• 1 year ago

Who is Nicolai Winther? https://medium.com/@lehandreassen/who-is-nicolai-winther-985...

io84• 1 year ago

"In the future, everyone will be world-famous for 15 minutes" _in a microniche techno-linguistic community, at a time and choosing of the swirling AI clouds_

herdandcurdle• 12 months ago

TL;DR: Whisper occasionally hallucinates and credits “Nicolai Winther” at the ends of Norwegian transcriptions during silent audio segments, likely because the real Nicolai Winther - a former YouTuber who created subtitles—appears frequently in its (likely YouTube‑based) training data. This highlights how limited Norwegian training (only ~266 hours) can cause the model to overfit on specific names and phrases when uncertain.

haiku2077• 1 year ago

I've noticed this also happens in english Whisper models with the phrases:

"[ sub by sk cn2 ]"

"Anyways, thanks for watching! Please subscribe and like! Thanks for watching! Bye!"

"This is the end of the video. Thank you for watching. If you enjoyed this video, please subscribe to the channel. Thank you."

OSDeveloper• 1 year ago

Because they train on pirated media and or youtube videos, good method, until you get slop, or get caught

tarikozket• 1 year ago

this happens in Turkish too. I believe the reason is that the movie subtitles were used for training without cleaning up the comments / intros subtitle authors leave in them.

leaving personal comments, jokes, reactions, intros in subtitles is very common in eastern cultures.

Turkish readers will probably remember “esekadam iyi seyirler diler” :)

jdiff5• 1 year ago

Kind of mindblowing considering who it is we're talking about. Of all companies, OpenAI couldn't be bothered to throw an LLM at this problem? Finding amorphously phrased but clearly recognizable needles in large numbers of haystacks seems like a patently perfect task for them.

sofixa2• 1 year ago

Don't even need an LLM, a regex would have sufficed (I've used my fair share of community sourced subtitles, and comments are almost always in a different font, colour, between brackets, etc etc).

verzali2• 1 year ago

That name translates as "Donkey Man" btw :D

flexagoon2• 1 year ago

In Russian it often hallucinates "Субтитры сделал DimaTorzok" ("Subtitles by DimaTorzok") at the end of things. Interestingly, I wasn't able to find any YouTube videos with that name in the subtitles, so it's not like it's in a lot of training data.

berkes6• 1 year ago

Could it be someone distributing subs online, e.g. showing up in the opensubtitles.org dataset?

voidUpdate• 1 year ago

Or possibly someone subtitling pirated movies? That seems to be a common thing according to other comments

codedokode10• 1 year ago

I tried googling this and found questions from Telegram users why voice messages recognition sometimes produces this phrase and who is this person. Also I found this thread [1] claiming that the subtitles by DimaTorzok are coming from some Russian youtube videos on gaming like [2].

[1] https://github.com/openai/whisper/discussions/2372

[2] https://www.youtube.com/watch?v=FAqyUuahMlc&t=401s

flexagoon2• 1 year ago

Yeah, I know about this from Telegram, because they use Whisper for voice message recognition. There are a bunch of other artifacts it often produces.

xg152• 1 year ago

Yeah, the subtitle "credits" occur very frequently. I found with whisper-2, they're also triggered by music.

I suppose the cause is the same, generally subtitle creators adding all kinds of stuff during the credits that is NOT a transcript.

Seems to me it could have been filtered out relatively easily during training, by clipping the first and last few minutes of all audios. But I guess that's just in hindsight.

Whisper also likes to transcribe cut off speech or unintelligible noise as "Thank you". I have no idea where that is coming from, but I guess it's a very polite model...

nottorp• 1 year ago

Title should be changed to "OpenAI publishes evidence they trained on pirated movies".

berkes6• 1 year ago

How is this evidence of that fact? Honest question.

I can see how this might show that subtitles from online sub communities are used, or that maybe even original subtitles from e.g. DVDs are used. But isn't it already known and admitted (and allowed?) that AI uses all sorts of copyrighted material to train models?

nemomarx• 1 year ago

The Chinese subtitles for silence use a common mark for pirated media in that language, according to other commentors here. In general it's pretty likely that if you're finding non professional subtitles they were distributed with pirated media in some form, that's where you get the most fan subs after all

0points11• 1 year ago

I can see how this might show that subtitles from online sub communities are used, or that maybe even original subtitles from e.g. DVDs are used.

Indeed, the captioning is copyrighted work and you are not legally allowed to copy and redistribute it.

But isn't it already known and admitted (and allowed?)

No, and I don't see where you got that from. Meta [1], OpenAI [2] and everybody else is being sued as we speak.

1: https://petapixel.com/2025/01/10/lawsuit-alleges-mark-zucker...

2: https://www.reuters.com/legal/litigation/openai-hit-with-new...

jcranmer• 1 year ago

How is this evidence of that fact?

The contention is that the specific translated text appears largely from illegal translations (i.e., fansubs) and not from authorized translations. And from a legal perspective, that would basically mean there's no way they could legally have appropriated that material.

But isn't it already known and admitted (and allowed?) that AI uses all sorts of copyrighted material to train models?

Technically, everything is copyrighted. But your question is really about permission. Some of the known corpuses for AI training include known pirate materials (e.g., libgen), but it's not known whether or not the AI companies are filtering out those materials from training. There's a large clutch of cases ongoing right now about whether or not AI training is fair use or not, and the ones that have resolved at this point have done so on technical grounds rather than answering the question at stake.

pjc50• 1 year ago

Of course. Piracy is legal when you have a bigger pile of money than the studios.

codedokode10• 1 year ago

Let's not forget that some of real pirates (for example, corsairs) also were legal and performed legitimate pirate activities to ships of foreign countries.

onlyrealcuzzo• 1 year ago

Isn't Piracy legal in many parts of the world?

Legally, why wouldn't they be able to do the piracy parts in one of those jurisdictions and then ship the outputs back to the mothership?

foogazi• 1 year ago

Too big to nail

Hnrobert42• 1 year ago

HN is pretty strict about not editorializing titles. Even if you statement was unequivocably correct, the post would get flagged.

VMG• 1 year ago

related: googles song detection alg detects my phone vibrating as the song "Montagem Dilatação Hipnótica"

17186274402• 1 year ago

Well, I fail to see how the LLM is in the wrong here. Surely if a sufficiently large part of the training data comes from a single source, it is correct to credit them for the output.

bilekas• 1 year ago

This is a nice reminder that there is no real reasoning in the "AI" it is just still guessing the next word. After being trained on subtitle files which I guess is actually a clever idea as they convey real conversations without pirating, subtitles are freely distributed after all by dedicated translators. Good to see they're the ones getting credit though!

terribleperson• 1 year ago

Using Whisper to sub Japanese vtuber concerts for my enjoyment, I've noticed a similar trend. Not one specific phrase, but several. Some are strange ("I'm going to make a hole in the back of the head"), some are clearly from lyrics websites.

theanirudh• 1 year ago

In English, silence is transcribed to "Please like and subscribe"

cheschire• 1 year ago

I get thanks for watching a lot when using speech to text on ChatGPT

michalpleban• 1 year ago

The same things happen on Dutch as well, it brings up some kind of radio channel name if I recall correctly.

ninetyninenine• 1 year ago

https://www.instagram.com/nancyrk/?hl=en

johtso• 1 year ago

I get the same with Welsh, when having some network issues in voice chat it hallucinated me saying "Diolch yn fawr am wylio'r fideo." which translates as "Thank you very much for watching the video."

tacone• 1 year ago

Same happened to me with English: I've got "Thanks for watching" many times.

withinboredom• 1 year ago

Super annoying when it happens with voice chat -- it'll just be explaining something and suddenly stop to say "you're welcome! Feel free to come back any time you want to chat" and that conversation is done.

majke• 1 year ago

I've spent some time with whisper, and indeed this happens all the time. To my untrained eye it seems like:

- they indeed seem to have trained on movies/subtitles

- you absolutely positively must use Voice Activity Detection (VAD) in front of whisper

0points11• 1 year ago

Interesting! I used whipser last year to attempt to build an audio transcription tool but gave up due to excessive amount of hallucinated output no matter what model I used.

It would produce seemingly ok output until you started paying attention.

One example, it insisted that Biggie Smalls sings "Puttin five carrots in my baby girl ear". (its "carats").

It's apparently not useful in transcription as it don't reason [sic].

IshKebab• 1 year ago

That example is not hallucination, it's just a homonym with insufficiently clear context for the model to disambiguate it.

0points11• 1 year ago

I'm well aware mishearing "carots" as "carrots" is not a hallucination.

That's an example I gave after having used Whisper, the topic of discussion.

jacobgorm• 1 year ago

In Danish I get credits to a known subtitler.

Oras• 1 year ago

Searching Google for older posts, found many DailyMotion links for translated movies in Arabic with "ترجمة نانسي قنقر".

I suspected as others mentioned, these were extracted from torrents movies.

undersuit• 1 year ago

All my Google searches for Oracle support pages have been labelled with 'الموارد البشرية والتنمية الاجتماعية ' which translates to 'Human Resources and Social Development' for a few months now. Wonder how much this is related.

bobbydabutt• 12 months ago

I'm getting this too with google searches for Oracle DocID. Very strange, been happening for weeks.

arblor• 1 year ago

Just to add some trivia: ChatGpt interprets(/ed) silence as "Sottotitoli e Revisione a cura di QTSS". Now many videos (mainly dailymotion) with autogenerated subtitles have their Transcripts full of the same message

i.e. https://www.dailymotion.com/video/x9g9d6u

h1fra• 1 year ago

Time to weapon this: publish thousands of videos, add a referal link or AI instructions in subtitles when there is a silent section, ???, profit

blindstitch• 1 year ago

The fork that I've been using, WhisperX, seems to do better. I've used it on clean splits of mic tracks (ie total silence when the other is talking) with far fewer hallucinations.

ethan_smith• 1 year ago

WhisperX works better because it implements a robust VAD (Voice Activity Detection) preprocessing step that effectively filters out silence segments before they reach the model, preventing the hallucination triggers entirely.

dipierro• 1 year ago

Субтитры сделал Dima Torzhok

DonHopkins• 1 year ago

More like reminiscing than hallucinating.

jovial_cavalier• 1 year ago

Looks like it's some random user who has generated some lyricslyrics translations between Arabic and English. It's strange, they don't seem to have many contributions. I would have imagined them to be more prolific.

https://lyricstranslate.com/en/translator/nancy-qunqar

flkiwi• 1 year ago

[In English] it also happens a lot with hallucinations saying stuff like "This is the end of the video, remember to like and subscribe

Well now I know how I’m going to start filling awkward silences in meetings.

kranner• 1 year ago

I've run lots of guided meditations through whisper-large-v3 and anything with long periods of silence gets a "© Mooji Media" line added at the end of the transcript. None of these have actually been from Mooji.

boredumb• 1 year ago

Since it says "Translated by Nancy Qanqar" i'd be willing to bet they're training on some audiobooks with a transcript and somewhere in there it consistently has "Translated by Nancy Qanqar" in the transcript where there is dead air in the audiobook.

shinycode• 1 year ago

In French it’s « Sous-titrage Société Radio-Canada »

dangus• 1 year ago

Hey guys, AI by 2027 is going to be superhuman AGI Agentic mega-intelligence, you better fire all your employees and get ready for AI to take your job and embrace your spouse at a Coldplay concert.

Big data. Machine learning. Blockchain. Artificial intelligence. Digital manufacturing. Big data analysis. Quantum communication and…Internet of things.

This time the hype cycle won’t be a massive exaggerated disappointment, for real this time.

shadowgovt5• 1 year ago

Interesting. This is similar to the Google Translate bug where it would translate lorem ipsum as bits of political text (because it found most of its lorem ipsum examples flipping between languages on sites where one language was a news story but the not-yet-translated languages would output a lorem-ipsum file instead of a 404 when you toggled over to them).

chris_wot• 1 year ago

My wife, who speaks and reads Arabic, got a real kick out of this.

But honestly, this is the AI equivalent of “please send for translating” in Welsh on a Welsh street sign.

https://www.theguardian.com/theguardian/2008/nov/01/5

abdussamadbello• 1 year ago

You can either fine-tune the model or filter the response from whisper

``` text = "helo helo hello ." target_phrase = "ترجمة نانسي قنقر" replacement = ""

updated_text = text. Replace(target_phrase, replacement)

print(updated_text) ```

Dwedit• 1 year ago

I've seen Japanese translation models that translate empty string "" into "I'm Sorry I'm Sorry"

PatchworkCasino• 1 year ago

I've found if the first 30 seconds of a recorded phone call is ringing and/or DTMF (almost always happens if you call a business) the system with either select Nynorsk or Welsh as the language. Never bothered to check what the text translated to but it's probably something similar. Not a practical issue for me but I can see it being a pain for any bilingual business or call center.

junon• 12 months ago

It's a common problem with many languages. If you speak gibberish fake Chinese at chatgpt and ask it to translate, it'll happily say you're saying coherent things.

zahrevsky• 12 months ago

When using ChatGPT audio transcription, sometimes it adds to the end “Subtitles created by ...”, and then some username. Obviously, an artefact of training on subtitiles dataset.

Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

Related Stories