HN user

naillo

1,899 karma
Posts11
Comments419
View on HN

This is so overcomplicated. You don't need an actual tree that's just a mental model. All you need to do is generate N random hyperplanes (defined via it's normal i.e. generate N normalized vectors in the dimension of your choosing). Then you generate a hash via these by going normal by normal and checking if your query vector `q` is on the left or right side of the normal by checking the sign of the dot product. I.e. `hash = [sign(dot(q, n1)), sign(dot(q, n2)), ...]`.

So given a query you find that hash and you get all the vectors with the same hash (using your favorite hash to array data structure, i.e. a dict) and you can further refine the search within that bucket. It's like 10 rows of code.

Not really irreversible unless they get a monopoly on violence, so as long as the overton window from the publics perspective shifts dominantly towards breaking them up in the future we'll be able to get a better situation.

I initially blocked that popup with ublock origin, but I've since turned it back off and let it block me instead. It's a fantastic way to prevent you from mindlessly watching videos. Now I just use yt-dlp to download videos I know I care about and subscribe to.

Good article but my god why is there like a 2 second delay before every user interaction on this page. Scrolling, selecting text, everything has some kind of 2 second 'bootup' time after which things work normally but if you stop interacting with it for a bit it goes back to some idle mode. Really weird.

I think it's just them being scared of models running on their servers producing things that cause bad PR. And the reason they're not willing to not run things on their servers is competitive advantage as well as just extracting more money out of users that way. (I definitely don't think actual safety is the concern.)

Well they could just not allow prompts that seem to participate in blogspam. If they wanted to stop it they definitely could.

Their argument is that since it's centralized, things like that are possible (while with llama2 you can't), they do "patch" things all the time. But since blobspam are contributing to paying back the billions microsoft expects they're not going to.

It's funny that one argument openai used to keep their models closed and centralized is so they could prevent things like this. And yet they're doing basically nothing to stop it (and letting the web deteriorate) now that profit has come into play.

This is all making me realize investors are just people with money (not these super intelligent market predictors that they're often portrayed). You'd do the same to market a product as you would to skim off the flood of money going into a hyped field I suppose.

They're amusing but they're definitely dangerous to the potential of AI in the medium term. People like to say that "these things will happen anyway" even if it's made illegal, but there's no way 250 million will be invested into a company to develop LLMs if they're made illegal or heavily regulated. ML is resource intensive as it is (in terms of number of PhDs required and compute) and if the decels and censors have their way they definitely can make a dent in progress (i.e. "it'll happen anyway" isn't true, or it'll be slowed down so much nothing interesting will happen within our lifetimes).

Mistral 7B 3 years ago

These things won't be 'all knowing': things that are kept secret by the government like how to make nuclear weapons won't be known by it, nor can you ask it what your coworker thinks of you and have it accurately tell the answer. They are however great reasoning and creative engines. I look forward to being able to boost that part of my workflow.

Funny how there's a large gap between the first job and second between age 19 and 37. Most of the list is after 37. Makes you think that the best years of your life for some people doesn't come after your 40s.

B612 Font Family 3 years ago

I wonder when we'll consider fonts as a 'solved' problem. I keep seeing designers making more of them, I guess it's just a tradition and hobby at this point

The way I see it regarding the point "but meta is also releasing models" is: there was one span of time between say 2014-2019 when mostly ML was just classifiers (nothing generative). People did open source those. Then there was a period between 2019-2023 when generative AI was possible. It's true that meta is releasing models in that space now finally. But there was an excruciating 3-4 year period between 2019 and 2022 when stable diffusion was finally made and released which opened the floodgates to others doing so as well. But I'm eternally grateful for emad and stabilitai for opening the gates that had been titillatingly closed for 4 annoying years.

I get that. I think it's really cool what they did and when musicians put in time and energy into making amazing tracks. I get enough satisfaction from my normal coding job though, I don't have time to dedicate my life to music like they have. So from that perspective I'm just happy that it's possible to get more music like that type. Just a cool thing that exists in the world now, but I still think working hard to realize an artistic vision is also cool, separately.

The conditional probability that the article is AI written is also so much larger when you encounter .ai tld's.

I meant private use and maybe share with a few friends. I actually agree with you that we probably shouldn't finetune on great artists and try to sell the output without modification or added creativity. Private or close friends sharing is fun and life enriching and inspiring though in my eyes.