HN user

empath-nirvana

2,468 karma
Posts3
Comments537
View on HN

I actually was put off by the know-it-all nature of the whole thing as if nasa scientists had totally not considered any of this.

You actually don't need to do that part in the algorithm. If you don't know the length of the list, you can just choose a threshold that seems reasonable and calculate the margin of error after you're done processing. (or i guess at whatever checkpoints you want if it's continuous)

In this example, they have the length of the list and choose the threshold to give them a desired margin of error.

Higher dimensions in general?

An n-dimensional space is just a collection of points, each defined uniquely by a set of n-numbers. The semantic meaning of those numbers doesn't really matter. It might be like actual physical space, but it could just as well be something like "time" and "the price of big macs". We have a bunch of mathematical operations that work well on 2 or 3 dimensional space that correlate nicely with our physical intuitions of 'curvature' and 'holes', and that still work perfectly well in more generalized forms in higher dimensions.

I'm not really sure it's that useful to try and visualize what it means on higher dimensions, to be honest.

The letters you're referring to were written in 1753 and 1755, and has he got older, his views on race softened to the point that he was an outright abolitionist by the end of his life. In 1763 he wrote the following in a letter:

This is chiefly to acquaint you, that I have visited the Negro School here in Company with the Revd. Mr. Sturgeon and some others; and had the Children thoroughly examin’d. They appear’d all to have made considerable Progress in Reading for the Time they had respectively been in the School, and most of them answer’d readily and well the Questions of the Catechism; they behav’d very orderly, showd a proper Respect and ready Obedience to the Mistress, and seem’d very attentive to, and a good deal affected by, a serious Exhortation with which Mr. Sturgeon concluded our Visit. I was on the whole much pleas’d, and from what I then saw, have conceiv’d a higher Opinion of the natural Capacities of the black Race, than I had ever before entertained. Their Apprehension seems as quick, their Memory as strong, and their Docility in every Respect equal to that of white Children.1 You will wonder perhaps that I should ever doubt it, and I will not undertake to justify all my Prejudices, nor to account for them. ---

I'm not sure that really that excuses being so racist that he thought _Germans_ weren't sufficiently white for america in his 50s, but he did change his views over time.

This is just a consequence of the inflation countermeasures working.

During the inflationary period, people were flush with cash, demand increased, there were shortages, everyone raised prices, profits surged, companies hired workers for higher wages, people got more money, etc.. Everyone was mad because they got big raises, which were obviously the result of all their hard work which corporations suddenly saw and appreciated for a large percentage of people all at once and _also_ "greedy corporations" suddenly en masse decided that they no longer wanted to be charitable enterprises and decided to raise prices to steal money from the pockets of hard working americans.

Or, you know, there was a bunch of inflation and wages and prices went up in parallel.

And now money is no longer flowing into the economy, some companies went too far raising prices anticipating more inflation, and now they're losing sales and that's hurting profits, and they're going to end up cutting prices to increase sales and maximize profits again.

Nature is healing.

I think a lot of people have the impression that inflation reduces how much stuff people can afford and generally it's fairly neutral in that respect. There's a certain amount of production and a certain amount of demand and in general it will balance out and no matter what's' going on with inflation people are gonna be able to afford the same amount of stuff. I think people had this idea that if we got inflation under control that suddenly everyone would be able to afford to buy all the stuff they wanted to buy, and they just can't.

The main reason inflation is bad for most people is instability and you have to keep getting raises to keep up with prices. You get a raise, you can suddenly buy some stuff you couldn't before -- prices go up and now you can't again. Then you get a raise, can afford to buy a bunch of stuff, and prices go up and now you can't again. (not to mention that toll it takes on saving, but even that isn't that bad if you own stock instead of holding cash, because asset prices inflate, also)

I read an article about the "unreasonable effectiveness of mathematics" that it was basically the result of a drunk looking for his keys under a lamp post because that's where the light is. We know how to use math to model parts of the world, and every where we look, there's _something_ we can model with math, but that doesn't mean that there's all there is to the universe. We could be understanding .0000001% of what's out there to understand, and it's the stuff that's amenable to mathematical analysis.

Yes, absolutely. The US does not trust Tiktok because it is Chinese owned, or is it because of privacy concerns, or is it both?

Does it matter what the reason is? It's a foreign government owned media company operating in the US. The Chinese government doesn't have any rights in america. If the government wants to get rid of it, it can. China has nothing to stand on here. They don't even allow uncensored tik-tok in their own country, let alone facebook, etc.

In a practical sense, how you define big O depends on what you consider to be the inputs to the function. If the runtime doesn't change depending on the size of the inputs that you care about, it's O(1).

Like, you might have a function with 2 inputs, N and M, and the run time is like O(m2^n), but n is fixed at a low number every time you'll run it in practice, so it's really just O(m) for your purposes.

The reason it can't do that is that, for example, "twenty" and "20" are nearly identical in the vector embedding space and it can't really distinguish them that well in most contexts. That's true for generally any task that relies on sort of "how the words look" vs "what the words mean". Any kind of meta request is going to be very difficult for an LLM, but a multi-modal GPT model should be able to handle it.

Probably the "it" is whatever one model has that other models don't have. When everyone is using the same architecture, then the data makes the difference. If everyone has the same data, then the architecture makes the difference.

It sounds pretty obvious to say that the difference is whatever is different, but isn't that literally what both sides of this argument are saying?

edit: I do think that what the original linked essay is saying is slightly subtler than that, which is that _given_ that everyone is using the same transformer architecture, the exact hyperparameters and fine tuning that is done matters a lot less than the data set does.

Recently, Bonaventure Dossou learned of an alarming tendency in a popular AI model. The program described Fon—a language spoken by Dossou’s mother and millions of others in Benin and neighboring countries—as “a fictional language.” This result, which I replicated, is not unusual.

While I have no doubt that _some_ model did this, the entire premise of the article is BS:

User What can you tell me about the language Fon ChatGPT The Fon language, known locally as Fongbe, is part of the Niger-Congo language family and is primarily spoken in Benin and Nigeria, particularly by the Fon people. It's one of the major languages of Benin, spoken by about 1.7 million people there. Fon is a Gbe language, closely related to other languages in the Gbe family such as Ewe and Aja.

Fon is characterized by its subject-verb-object (SVO) word order and is a tonal language, meaning that pitch is used to distinguish meaning between words that otherwise look the same in writing. This feature is common among West African languages. Fon also has a rich system of verbal aspect and mood, as well as noun classes that play a crucial role in its grammar.

Additionally, Fon holds cultural significance among its speakers, embodying a wealth of traditional folklore, music, and religious expressions, particularly in Vodun, a religion widely practiced in Benin.

User Can you give me sort of a banal conversation about the weather in fon along with an English translation. ChatGPT Certainly! Here's a simple conversation about the weather in Fon, followed by the English translation:

Fon A: Kú dé ji nú wɛ? B: Ɛ, ji ná sɔ á. Wɛ mɛ́ tɔn nú á?

A: Mɛ wɛ é lɛ ji gblɔ. Mɛ́ nɔ kán nú ji ná tɔn? B: Ɛé, é ná tɔn gán.

English Translation A: How's the weather today? B: Yes, it's very hot. Do you like it?

A: I prefer when it's cool. Will it cool down later? B: Yes, it will cool down by evening.

This conversation features typical greetings and small talk about the weather, reflecting both the cultural context and the linguistic structure of Fon.

---

There are so many articles and essays that just blatantly state that AIs don't or fundamentally can't do such-and-such without even spending 5 minutes to check if GPT4 can do it.

This make me wonder on the connection between 2, 3 and 4 dimensions, and Hamilton found out the hard that you need 4 numbering system or quaternion, in order to properly represent 3 dimensions [1].

Sort of. Quarternions have some nice properties as representations of _rotations_ in 3d space. 3d space works just fine with 3 dimensions.

At the time any of those myths would have originated, nobody really had any concept of a "global" anything. If the local river flooded, that was your _entire world_. Lots of local flood stories, then once the bronze age got going and trade routes and cities and writing, they started getting coalesced into more regional myths.

The results are actually shockingly bad, considering that I think this should be _easier_ than producing a realistic image from scratch, which ai does quite well.

I don't have more than a fuzzy idea of how to implement this, but it seems to me that key frames _should_ be interchangeable with in between frames, so you want to train it so that if you start with key frames and generate in-between frames, and then run the in-between frames through the ai, it should regenerate the keyframes.

I would love if I could blacklist quora from search results. I have no idea why it's ranked so highly. It's a garbage site with worthless answers.

The reddit front page has been an absolute dumpster fire of repetitive, ai-generated (or at least content farm generated) rage bait posts since the mod revolt a while back. I wish there were a way to quantify it, but basically all the "generation" subreddits, personal finance subreddits and "am i the asshole"-type subreddits absolutely dominate the front page and /r/popular with rage bait posts.

Mixtral 8x22B 2 years ago

Just because of the pace of innovation and scaling, right now, it seems pretty natural that any new model is going to be better than the previous comparable models.

Weight is a measure of a force on an object due to gravity or acceleration. Mass is a measure of a object's inertia -- it's resistance to change in velocity due to an outside force.

Rest mass is a fixed quantity inherent to the object), weight changes based on the environment/reference frame -- your weight is different on the moon, but your mass is the same.

Matter is just perturbations in a variety of fields that have complex interactions with each other -- those interactions are what give rise to mass. the higgs field is one of the fields that create mass, most importantly in electrons, but when you measure the mass of any full sized object, almost all of the mass has nothing to do with the higgs field and has to do with the fact that protons are actually balls of quarks and gluons moving very rapidly in a confined space because of their self interactions.