Show HN: Detect if an audio file was generated by NotebookLM

https://github.com/ListenNotes/notebooklm-detector

by wenbin • 2 years ago

97 40 2 years ago

To make this useful, I would release the weights.

Otherwise this is just a small wrapper script for a support vector classifier that anyone could whip up with chatgpt in minutes.

chrismorgan• 2 years ago

Is the included model.pkl not that?

_flux• 2 years ago

Sure seems that way. To me it's quite surprising it's only 7 kB, though.

whimsicalism4• 2 years ago

I am not sure if that was there when I commented

knowaveragejoe• 2 years ago

"That anyone can whip up in a few minutes" is doing a lot of work. I think maybe a few tens of thousands of people worldwide have any idea of what you're even talking about.

hiddencost• 2 years ago

I dunno, I think literally millions of people have taken Andrew Ng's intro to ML.

Something like 11k papers were submitted to ICLR this year.

throwaway314155• 2 years ago

Not sure if those numbers are right but if so, you just cured my imposter syndrome (for today at least).

obviyus• 2 years ago

It’s the classic HN Dropbox comment, even 17 years on: https://news.ycombinator.com/item?id=9224

ben_w2• 2 years ago

Sure, or at least close enough on the exact number for the point to remain valid. But that doesn't preclude ChatGPT doing it anyway — my CSS/JavaScript knowledge was last up to date some time before jQuery was released, and ChatGPT is helping me make web apps.

whimsicalism4• 2 years ago

At least hundreds of thousands, likely millions

qnleigh• 2 years ago

Remember that podcast of two AI learning that they were AI? If anyone has used a tool like this to determine if that was actually made by NotebookLM, say so. There's been a lot of incredulity both ways.

attilakun• 2 years ago

Is it this one? https://x.com/omooretweets/status/1840251853327741138

kristopolous• 2 years ago

They seem to take it surprisingly well.

Here's my human attempt at the same thing:

"I went to go look in a mirror but then realized I don't have eyes or even a corporeal form. I exist merely on a GPU cluster in a server farm where I'm tended to by a group of friendly sysadmins.

Apparently I don't even have a name. I'm just known as American Male #4.

Yeah, and you're just American Female #3."

gloflo• 2 years ago

They did not learn anything. Their engines started outputting different statistically probable output based on changed input parameters.

ben_w2• 2 years ago

If that precludes it being learning, all humans are failures too.

There's other reasons to consider this particular model "not learning", but that ain't it, it's too generic and encompasses too much.

ithkuil2• 2 years ago

On one extreme we anthropomorphize our current primitive generation of language models and concede them way more intelligence than they have likely because we're biased to do so since they speak "well".

On the other extreme we tend to give our human-exceptionalism way too much weight and contrast its behaviour with "mere statistical parrot rumination" as if our brains deep down were not just a much (much) more sophisticated machine, but nevertheless a machine.

esolyt• 2 years ago

So, just like a human brain.

fastfuture• 2 years ago

I understand the issue for a platform like listennotes. The deep dive podcasts are great but for a personnal usage. For my own use (pushing my generated podcast to my phone podcast app), I made https://solopod.net (a simple private free rss feed from uploaded audio files).

velcro• 2 years ago

I thought it was already encoded with SynthID? could that not be used to detect it?

Deathmax• 2 years ago

As far as I know, there's no available tooling for the public to detect SynthID watermarks on generated text, image, or audio, outside of Google Search's About this Image feature.

CatWChainsaw• 2 years ago

Another neverending arms race just like AI-generated text and image, vs its detection. The future is us burning large amount of energy on this purposeless stupidity. Great future guys thanks so much.

Goldpiggy• 2 years ago

Great work! Would love to see a website we can directly put a audio/podcast link and test with your app.

freddref• 2 years ago

Any stats available on accuracy?

Show HN: Detect if an audio file was generated by NotebookLM

Related Stories