HN user

gr3ml1n

198 karma

@gremlin_sh on x

Posts0
Comments54
View on HN
No posts found.
GPT-5 12 months ago

The counter-argument to this from the AI crowd would be that it's fundamentally impossible for _us_, with our goopy brains, to understand how to do it. Something that is factorial-orders-of-magnitude smarter and faster than us could figure it out.

Yes, it's a very hand-wavey argument.

GPT-5 12 months ago

Well, first, it would be so far beyond anything we can comprehend as intelligence that even asking that question is considered silly. An ant isn't asking us how we measure the acidity of the atmosphere. It would simply do it via some mechanism we can't implement or understand ourselves.

But, again with the caveats above: if we assume an AI that is infinitely more intelligent than us and capable of recursive self-improvement to where it's compute was made more powerful by factorial orders of magnitude, it could simply brute force (with a bit of derivation) everything it would need from the data currently available.

It could iteratively create trillions (or more) of simulations until it finds a model that matches all known observations.

GPT-5 12 months ago

It starts to veer into sci-fi and I don't personally believe this is practically possible on any relevant timescale, but:

The idea is a sufficiently advanced AI could simulate.. everything. You don't need to interact with the physical world if you have a perfect model of it.

But, what other fields would it do this in? How can it makes strives in biology, it can't dissect animals ...

It doesn't need to dissect an animal if it has a perfect model of it that it can simulate. All potential genetic variations, all interactions between biological/chemical processes inside it, etc.

That isn't true. Dedicated bodybuilders, starting more commonly ~5 years ago, decided that PCT wasn't worth it. Instead of typical 16-20 week cycles followed by 4-6 weeks of PCT, they adjust the dose between supraphysiological and (generally) top-of-normal, i.e.: blast and cruise.

It's not because they couldn't recover, it's because they don't want to or see the point.

Well, definitely don't phrase it exactly like that.

Most decisions that would be made in the context where this is a useful technique are irrelevant and/or obvious. They should be made by someone lower down the chain, but organizational dysfunction requires tricks like this to get anything done.

The suggestion is that negative reviews are suppressed. Communicating a negative review through a facially positive review would help avoid that.

Not really. Everything is downstream of the pressure on organizations to address disparate impact. Some examples:

When a company is under pressure to boost the number of X engineers, they quickly run into the 'pipeline problem'. There simply isn't enough X engineers on the market. So they address that by creating scholarship funds exclusively for race X.

When a school is under pressure to have the racial makeup of it's freshman class meet the right ratios, it has to adjust admission criteria. Deprioritize metrics that the wrong races score well on, prioritize those that the right races score well on. If we've got too many Y, and they have high standardized test scores? Start weighing that lower until we get the blend we're supposed to have.

The goal of the college is not to get the students with the strongest academic record: it's to satisfy the demand for the right ratios.

Repeat over and over in different ways at different institutions.

Is there an example where colorblind hiring had a nil or opposite effect? In places I've seen, the opposite has happened. For example ...

The study underlying that post is a great example of another downstream effect of DEI efforts. That study did _not_ show what the headline or abstract claimed.

When you hide the gender of performers, it ends up either nil or slightly favoring men. That particular study has been cited thousands of times, and it's largely nonsense.

http://www.jsmp.dk/posts/2019-05-12-blindauditions/blindaudi...

If anything’s really losing credibility right now, it’s the myth of a pure American meritocracy.

It only became a myth when we were forced to consider factors beyond merit in hiring.

I'll try to assume good faith, but this is the sort of framing often used in the waning days of unpopular ideas.

That's not what DEI ever was. It fundamentally came down to evaluating disparate impact and then setting targets based on it. The underlying idea is that if a given pool (in the US, generally national- or state-level statistics) has a racial breakdown like so:

  10% X
  30% Y
  60% Z
But your company or organization had a breakdown of:
  5% X
  25% Y
  70% Z
You are institutionally racist and need to pay money to various DEI firms in order to get the right ratios, where 'right' means matching (or exceeding) the population for certain ethnic minorities. The 'certain ethnic minorities' value changed over time depending on who you would ask.

The methods to get 'the right ratios' varied from things like colorblind hiring (which had a nil or opposite effect), to giving ATS-bypassing keywords to minority industry groups (what the FAA did here).

RLHF Book 1 year ago

SFT can be used to give negative feedback/examples. That's one of the lesser-known benefits/tricks of system messages. E.g:

  System: You are a helpful chatbot.
  User: What is 1+1?
  Assistant: 2.
And
  System: You are terrible at math.
  User: What is 1+1?
  Assistant: 0.
RLHF Book 1 year ago

This feels like a category mistake. Why would R1 make RLHF obsolete?

RLHF Book 1 year ago

Your description of distillation is largely correct, but not RLHF.

The process of taking a base model that is capable of continuing ('autocomplete') some text input and teaching it to respond to questions in a Q&A chatbot-style format is called instruction tuning. It's pretty much always done via supervised fine-tuning. Otherwise known as: show it a bunch of examples of chat transcripts.

RLHF is more granular and generally one of the last steps in a training pipeline. With RLHF you train a new model, the reward model.

You make that model by having the LLM output a bunch of responses, and then having humans rank the output. E.g.:

  Q: What's the Capital of France? A: Paris
Might be scored as `1` by a human, while:
  Q: What's the Capital of France? A: Fuck if I know
Would be scored as `0`.

You feed those rankings into the reward model. Then, you have the LLM generate a ton of responses, and have the reward model score it.

If the reward model says it's good, the LLM's output is reinforced, i.e.: it's told 'that was good, more like that'.

If the output scores low, you do the opposite.

Because the reward model is trained based on human preferences, and the reward model is used to reinforce the LLMs output based on those preferences, the whole process is called reinforcement learning from human feedback.

I can think of situations where all four make sense. Not sure what you mean?

result+no error: data returned, no error happened. - Typical function call where you want some data.

no Result+error: nothing to return, error happened. - That typical call failed.

result+error: partial result, up to error. - Wrote x bytes to disk, then ran out of space.

no result+no error: nothing to return, no error. - Data for a passed query. Nothing came back, but that's not an error.

Mistral Small 3 1 year ago

Not surprising at all: Nvidia doesn't want to compete with their own datacenter cards.

Starship Flight 7 2 years ago

The higher frequency of launches seems likely to have a big impact on reliability. It's no different than deploying once per day vs once per month. The more you do it, the more edge cases you hit and the more reliable you can make it.

SpaceX also has a simplification streak: the Raptor engines being the canonical example. Lower complexity generally means less unexpected failure modes.

Say you run a small ISP. You pay for (and utilize) a 10Gbps link to the internet from a big ISP: Cogent, maybe.

You look at your network traffic and notice 5Gbps of it all seems to be going to a single AS: Google. Your customers just love Youtube, and they are pulling down a ton of video.

Rather than leaving that as an interesting factoid, you decide to reach out to Google and pitch them on cutting out Cogent. You run a cable (more-or-less literally) from your network to Google. That 5Gbps of Youtube traffic is running over your connection directly to Google.

Now you can go back to Cogent and drop your commit from 10Gbps to 5Gbps, saving you a bunch of money. Google doesn't have to pay them for transit either: they can serve content to your users straight through the cross-connect. Win-win.

If a particular company is _really_ big, say: Netflix, Cloudflare, etc: you, as a small ISP, might even offer to give them some space in your server racks to host local caches. This makes the performance better for your customers, and, again: saves transit costs.