Beginner dev looks at how YouTube sends videos

https://vincentsg.dev/dec31?

by vsgherzi • 3 years ago

150 58 3 years ago

vincentsg.dev

vsgherzi• 3 years ago

Super early on in my carrier. Just wanted to download an mp3 from my favorite artist without weird ads or tracking

SushiHippie• 3 years ago

I'd recommend you to have a look at yt-dlp [0] and NewPipe extractor [1]

[0] https://github.com/yt-dlp/yt-dlp [1] https://teamnewpipe.github.io/documentation/

ramesh313• 3 years ago

You got the knack, bud, and that's all it takes. Plenty of people have finished CS degrees without acquiring the knack. But that's really all it takes. If you've got it, it's just a matter of time before you're knocking people's socks off.

swyx2• 3 years ago

i find it interesting how some HN threads are super supportive like this one and others tear people apart for overstating their expertise, getting overleveled job titles as a "senior" developer while missing some esoteric/deep knowledge. we're all on our meandering paths somehow.

np1810• 3 years ago

Well written article... nitpick - your article date [1] as of posting this comment is DEC 31 2024...

fullstack dev versus youtube - DEC 31 2024

[1] https://vincentsg.dev/blog/

gverrilla• 3 years ago

Also the coffee in the image is yellow, which is really weird.

geraldhh• 3 years ago

sure thing, who doesn't

NiekvdMaas• 3 years ago

Nice write-up! For a better maintainable version, I would recommend `yt-dlp --dump-json` instead. This will give you hundreds of other supported sites for free.

thecleaner• 3 years ago

Now that is how you spend new year. Also beginner dev ? Dont be so modest mate.

ramesh313• 3 years ago

This rules. Pull back the curtain and vanquish the black magic. We should all know how this stuff works, if only to protect ourselves.

sam1r• 3 years ago

>> I quickly threw together an ugly frontend and posted it to digital ocean under an express server and prepped another project to repair my broken discord bot.

That is quite some versatile lingo for a beginner dev.

coolandsmartrr• 3 years ago

The original post doesn't mention "beginner", so I'm not sure why OP (link poster) decided to editorialize it as such.

mikepurvis• 3 years ago

Pretty sure this is a self-submission, based on the user's comments elsewhere in the thread.

akoboldfrying• 3 years ago

OP describes themselves as a "new developer":

Big shoutout to the invidious project and tyrrrz's blog they did basically all of the heavy lifting for this new developer!

marginalia_nu• 3 years ago

To be fair, we could all probably benefit from regarding ourselves as beginners [1]

[1] https://en.wikipedia.org/wiki/Shoshin

throwaway19dmfa• 3 years ago

To be fair there are a lot of people who are familiar with tech stuff and have just never actually learnt any sort of "dev" properly before who I would consider as beginner.

These people also tend up pick things up very quickly at the beginning and are able to use the right lingo after a few months of learning -- anyone who has done a few months of a bootcamp can talk/write like that even if they don't have a deep understanding of what they are talking about.

cammikebrown• 3 years ago

I don’t know how to program but I know what all of that stuff means

akaBruce• 3 years ago

The author mentions

After all I’ve been a full stack dev for a little bit (just graduated college!)

I'm guessing they differentiate being a dev (professionally or looking for work) from a student perhaps?

VoodooJuJu• 3 years ago

Has the bar lowered? Because I'd consider this lingo pretty accessible and 101 for a beginner anno domini 2024.

katella• 3 years ago

Is there a way to do this clientside?

Daneel_• 3 years ago

yt-dlp is the project you want

swyx2• 3 years ago

i picked a random video and noticed that the audio (mp3) download was the same filesize as the video (mp4) download. this seems wrong. some thing to do in the encoding?

justinclift• 3 years ago

Maybe it's sending the same bitstream for both?

c1ncy28• 3 years ago

He's just downloading both the aac audio and h264 video stream, and then renaming the resulting mp4 file to .mp3

tintedfireglass• 3 years ago

uhh the blog is wrongly dated 31st Dec 2024 instead of 2023.

account-5• 3 years ago

This is cool. I wish I could do this sort of thing, however when I come up again something like this I assume it's already been done and go look for the solution. In this case I'd likely have just used yt-dlp. However, had that project been dmca'd, by disreputable organisatios I'd likely have remained stuck, so kudos.

pocketarc• 3 years ago

The end of the post talks about hiring him, and honestly, if anyone’s hiring, here’s one heck of a bargain: Someone who’s just starting out but who’s already shown he’s perfectly capable of figuring stuff out by himself.

darylteo• 3 years ago

Definitely shows good intuition. Even if not doing the actual figuring out, still finds a possible solution and reverse engineers it. Forget 10x developer, this is the 10% of developers.

Open to any ideas how this level of intuition can be imparted at scale...

rpmisms• 3 years ago

It's a style of thinking. It can be taught, but mostly by example.

otteromkram• 3 years ago

Looks like they graduated college.

Oh... that's ALOT of parameters

If they would just learn that "a lot" is two words.

Given that their resume says Coding Ninjas tutor and Coding Ninjas is one of the worst websites out there for coding challenges and tutorials, while using incorrect syntax for Python and C++ (probably to lazily port problems from one language to another), this makes sense.

I'll probably get downvoted for my comment because of all the "touchy feelys" around here, but a lot of people can do what OP did sans college. What makes them extra hireable? Because they had a hacker news story catch some action on a holiday weekend?

pw6hv• 3 years ago

If I was a hiring manager, I would certainly appreciate this attitude. However, I would value as well a person who would use an already made tool for doing the job (such as yt-dlp). Only problem is that the second type wouldn't write a blog post about it and get traction on HN :D

petepete• 3 years ago

Yeah but you'd be mad to value them equally.

hysan• 3 years ago

However, I would value as well a person who would use an already made tool for doing the job (such as yt-dlp).

Agree, but I think this is the easier of the two skills to teach. So for a junior, I would hire the former if the company has the capacity to mentor them.

cebert• 3 years ago

To most employers it’s more that he can pass two Leetcode mediums and one Leetcode hard in tight time constraints. Just to make sure he’s good, make him do multiple rounds. The Leetcode grinder is quite representative of what software engineering is like in the real world.

c-c-c-c-c• 3 years ago

I really dont want to work at whatever company you're at.

poiuyt098• 3 years ago

idk, hard to believe that with spellcheckers being built into every text editor, the post is riddled with errors. Very sloppy or almost intentional.

arcza• 3 years ago

Thanks for posting and well done. Small suggestion for your writing style: use less ALL CAPS / BOOM! / WOW! styles and embrace less dramatic wording: it would make your site read more professionally and be easier to digest. Good luck.

243423443• 3 years ago

I enjoyed the writing style.

ResNet• 3 years ago

Same here, it felt authentic -- a really fun read.

sevagh2• 3 years ago

Their tone reflects their excitement, it's authentic and great.

rad_gruchalski• 3 years ago

No. What you get is this kind of communication in work email and all over slack.

Boom, wow, a dozen random emojis and even the author has no clue what these emojis suppose to mean.

withinboredom• 3 years ago

It’s a blog, not a research paper.

mcny3• 3 years ago

I tried a YouTube shorts video I saw yesterday that for some reason failed to download with yt dlp (also tried with newpipe) to see if this would behave differently.

https://www.youtube.com/watch?v=JQgKhZZyBYg

Something is squirly with this YouTube video. Can someone else give it a try?

phantomathkg• 3 years ago

try remove the url and just `yt-dlp JQgKhZZyBYg`

mcny3• 3 years ago

that worked. strangely enough.

---snip--- yt-dlp.exe --restrict-filenames --trim-filenames 30 --format "bestvideoext=mp4+bestaudioext=m4a/mp4" -i "JQgKhZZyBYg"

Monday, January 1, 2024 10:46:45 AM [youtube] Extracting URL: JQgKhZZyBYg [youtube] JQgKhZZyBYg: Downloading webpage [youtube] JQgKhZZyBYg: Downloading ios player API JSON [youtube] JQgKhZZyBYg: Downloading android player API JSON [youtube] JQgKhZZyBYg: Downloading m3u8 information [info] JQgKhZZyBYg: Downloading 1 format(s): 22 [download] Resuming download at byte 130048 [download] Got error: 0 bytes read, 10462009 more expected. Retrying (1/10)... [download] Got error: 0 bytes read, 10052978 more expected. Retrying (2/10)... [download] Got error: 0 bytes read, 10373389 more expected. Retrying (3/10)... [download] Got error: 0 bytes read, 10107360 more expected. Retrying (4/10)... [download] Got error: 0 bytes read, 10307771 more expected. Retrying (5/10)... [download] Got error: 0 bytes read, 10202520 more expected. Retrying (6/10)... [download] Got error: 0 bytes read, 10455655 more expected. Retrying (7/10)... [download] Got error: 0 bytes read, 9968301 more expected. Retrying (8/10)... [download] Got error: 0 bytes read, 10027086 more expected. Retrying (9/10)... [download] Got error: 0 bytes read, 10392472 more expected. Retrying (10/10)... [download] Got error: 0 bytes read, 10022086 more expected. Giving up after 10 retries

Monday, January 1, 2024 10:46:51 AM

--- snip ---

yt-dlp.exe "JQgKhZZyBYg"

Monday, January 1, 2024 10:48:03 AM [youtube] Extracting URL: JQgKhZZyBYg [youtube] JQgKhZZyBYg: Downloading webpage [youtube] JQgKhZZyBYg: Downloading ios player API JSON [youtube] JQgKhZZyBYg: Downloading android player API JSON [youtube] JQgKhZZyBYg: Downloading m3u8 information [info] JQgKhZZyBYg: Downloading 1 format(s): 247+251 [download] Destination: Jet crashes at Thunder Over Michigan air show at Willow Run Airport [JQgKhZZyBYg].f247.webm [download] 100% of 8.37MiB in 00:00:00 at 17.44MiB/s [download] Destination: Jet crashes at Thunder Over Michigan air show at Willow Run Airport [JQgKhZZyBYg].f251.webm [download] 100% of 599.52KiB in 00:00:00 at 3.53MiB/s [Merger] Merging formats into "Jet crashes at Thunder Over Michigan air show at Willow Run Airport [JQgKhZZyBYg].webm" Deleting original file Jet crashes at Thunder Over Michigan air show at Willow Run Airport [JQgKhZZyBYg].f247.webm (pass -k to keep) Deleting original file Jet crashes at Thunder Over Michigan air show at Willow Run Airport [JQgKhZZyBYg].f251.webm (pass -k to keep) Monday, January 1, 2024 10:48:07 AM

qingcharles3• 3 years ago

Huh, also failed with YouTube Downloader latest version. It got the thumbnail and the list of streams but couldn't download it. WTF?

mcny3• 3 years ago

my guess YouTube either purposefully or accidentally failed to serve an mp4 for this because looks like webm download works

date; yt-dlp.exe --restrict-filenames --trim-filenames 30 --format "bestvideoext=mp4+bestaudioext=m4a/mp4" -i "JQgKhZZyBYg"; date;

    Monday, January 1, 2024 10:53:15 AM
    [youtube] Extracting URL: JQgKhZZyBYg
    [youtube] JQgKhZZyBYg: Downloading webpage
    [youtube] JQgKhZZyBYg: Downloading ios player API JSON
    [youtube] JQgKhZZyBYg: Downloading android player API JSON
    [youtube] JQgKhZZyBYg: Downloading m3u8 information
    [info] JQgKhZZyBYg: Downloading 1 format(s): 22
    [download] Destination: Jet_crashes_at_Thunder_Over_Mi.mp4
    [download]   0.9% of   13.42MiB at    2.62MiB/s ETA 00:05[download] Got error: 138391 bytes read, 10282680 more expected. Retrying (1/10)...
    [download] Got error: 0 bytes read, 10230994 more expected. Retrying (2/10)...
    [download] Got error: 0 bytes read, 10302760 more expected. Retrying (3/10)...
    [download] Got error: 0 bytes read, 9963536 more expected. Retrying (4/10)...
    [download] Got error: 0 bytes read, 10084597 more expected. Retrying (5/10)...
    [download] Got error: 0 bytes read, 10318710 more expected. Retrying (6/10)...
    [download] Got error: 0 bytes read, 10071239 more expected. Retrying (7/10)...
    [download] Got error: 0 bytes read, 10341419 more expected. Retrying (8/10)...
    [download] Got error: 0 bytes read, 10356985 more expected. Retrying (9/10)...
    [download] Got error: 0 bytes read, 10212427 more expected. Retrying (10/10)...
    [download] Got error: 0 bytes read, 10277275 more expected. Giving up after 10 retries

    Monday, January 1, 2024 10:53:20 AM

xwowsersx• 3 years ago

What does the author mean that he "created a fetch request in node using the android example"? He means he made the request using Node and impersonated an Android client?

chupapimunyenyo• 3 years ago

Yes

orenlindsey• 3 years ago

Here's my favorite site for downloading YouTube videos. https://github.com/micahlt/vesper

It's made by a friend of mine, I thought he had a writeup about it, but I can't find it.

arwineap• 3 years ago

There is basically nothing a beginner could learn with that is completely novel.

We can probably assume this gentlemen already knew about yt-dl and it's derivatives; that wasn't the point of the exercise.

remram• 3 years ago

Is "fullstack developer" just "web developer"?

Beginner dev looks at how YouTube sends videos

Related Stories