HN user

cosbynator

472 karma
Posts13
Comments43
View on HN

Haha, no but that's neat. The generation process is a sampling procedure so "anything goes" and it can stumble on unlikely samples from time to time. I should probably filter out recursive ones!

Good call, when you press "generate your own" it tries to detect these and displays a little warning but my blacklist is not complete. My model is bolted on top of GPT-2 which used the web as a training set which is probably why some of these are popping up.

For slang, I'm training another modelusing urban dictionary as the datasource. I hope to release it someday but there is a lot of work to be done to clean the data. The articles are huge, user-generated and full of racism.

For example if it consumes lots of data that uses the pronoun "he" for doctor, it's much more likely to spit out "he" in a medical context.

Since the model lacks world knowledge for new words, sometimes it also ascribes words to a specific cultural origin / group that is completely wrong.

Both Alex and I are from Toronto (we are the engineers on Hyperlapse). I shot it on a little visit at the start of the summer and it became our go-to demo. That water taxi is particularly windy, bumpy and beautiful.

Good point - this is a view of the English speaking world as an aggregate. I'm hoping to re-run this experiment on non-US Wikipedia sites. If there are any interesting differences I'll try to put together a new visualization :)

Cool! I didn't know about this. The score I compute is actually a PageRank, which takes into account the quality of inbound links rather than just the raw number. I'd be interested to try to see how well this correlates to page visits!

That's certainly a downside. I've been meaning to run this on non-english Wikipedias to see the similarities and differences. A subject for a future blog post :)

You definitely aren't wrong, but it is worth noting that the PageRank is calculated based on all wikipedia articles, and not just those of movies (so influence into other areas will hopefully bubble up). "Birth of a Nation" actually does show up quite prominently for the pre 1930s era.

You make a good point, on second thought EC2 is a pretty good development environment as long as you aren't GUI dependent.

I still don't think it is a good development environment for someone that finds a node.js install too complicated. This seems to be what the article suggests.

15 years ago

Not to be too pedantic, but little omega is not the first uncountable ordinal (it is countable by definition), it is the first infinite one.