HN user

TideAd

257 karma
Posts0
Comments65
View on HN
No posts found.

The authors are basically asking the alignment problem to be well-defined and easy to model. I sympathize. Unfortunately the alignment problem is famously difficult to conceptualize in its entirety. It's like 20 different difficult counterintuitive subproblems, and the combined weight of all the subproblems that makes up the risk. Of course probabilities are all over place. It'll remain tricky to model right up until we make a superintelligence, and if we don't get that right then it'll be way too late for government policy help.

So, this is actually an aspect of superintelligence that makes it way more dangerous than most people think. That we have no way to know if any given alignment technique works for the N+1 generation of AIs.

It cuts down our ability to react, whenever the first superintelligence is created, if we can only start solving the problem after it's already created.

Yes, they see it as the top problem, by a large margin.

If you do a lot of research about the alignment problem you will see why they think that. In short it's "extremely high destructive power" + "requires us to solve 20+ difficult problems or the first superintelligence will wreck us"

"I don't think it's crazy to believe that half the white-collar staff at Google probably does no real work," he said. "The company has spent billions and billions of dollars per year on projects that go nowhere for over a decade, and all that money could have been returned to shareholders who have retirement accounts."

So, he doesn't really understand Google's dysfunction and is just guessing at the causes?

Once your number as high as $5.6m, is that even plausibly within the scope of early retirement?

I feel like a lot of the value of getting a specific number is getting spooked by it! And then facing some real choices. Is it really worth N years of my working life to [live in the most expensive city in America] / [buy a large home] / [pay for 4 years of expensive American universities]?

And this isn't even touching on stuff tech people often want that OP doesn't (private schools / resort vacations / expensive winter sports).

I find this very strange, Microsoft has a lot of big internal high-performance services written in C#.

You have to be intentional about some things - largely making sure objects are very short-lived or very long-lived, to avoid long GX pauses. But .NET performs much better than it did 10-15 years ago and I can't think of a fundamental reason why you'd rewrite in Rust.

This is a pretty rude generalization, though I get it.

As you grow in this career I promise you'll see people with real, serious problems caused/exacerbated by their white-collar jobs.

I don't think the difficulty of other careers means we shouldn't demand fair treatment for ourselves. Is letting ourselves get treated poorly supposed to help them?

My aunt and uncle, whose main hobbies are drinking beer and watching football, pulled me aside at their daughter's wedding ceremony to tell me how much they love ChatGPT.

My friend is a librarian at a high school. She tells me teachers are worried about what ChatGPT means for take-home essays. (I'm guessing 2023 is the year these stop getting assigned)

Everyone in the world with internet now has access to a personal research assistant. This thing gives better medical advice than doctors!! Give it 3 years and let's see who hasn't heard of ChatGPT.

I worked a little investment firm in college. A few years ago I looked up my boss, the owner. Found out he was in prison! For stealing $10m from a bunch of retirees in a really careless, sloppy way.

I think a surprising amount of people try it. But every SEC indictment is not news so we don't hear about the people who go to prison.

Remember in the hot 2021 hiring market when Coinbase revoked offers because of a layoff? I remember deciding they were on my blacklist after that. I thought their leadership and recruiting were too disorganized to trust with my career.

Of course you can lose your job at any time, but letting a candidate quit their old job and relocate and then get laid off is not something that should ever happen.

And now it's layoff season, and every big company has recently done this to huge numbers of people.

So as a labor force, what do we do about this? How to we protect ourselves now that the deal between employers and employees has broken down even further?

Yeah, personally I like to know what the team & I are being evaluated on.

I've been in the opposite situation, where there are priorities and goals that aren't communicated to me until way too late, and I ended up wasting a lot of time on stuff that didn't matter.

(Related: https://slatestarcodex.com/2017/02/09/considerations-on-cost...)

A way I sometimes think about it: humans have made great technological leaps, but every day is a battle against decay. Everything that actually looks stable is mostly kept that way through effort:

- most large internet sites that seem automated actually have engineers on-call 24/7. it requires constant operational work

- every machine has parts that must be replaced periodically

- the friend group tries to meet at least twice a month so you can all remain in each others' lives

So it is not unusual to see progress happening concurrently with decay. I feel similarly to the OP but I think we're bound to end up with a bunch of things that are getting worse in a given year.

I liked the Teams video calls.

But did you ever try to search for a message in a conversation, and have it give you just the message you wanted, without any surrounding context? Or have you ever tried to scroll through chat history, only for it to lazy-load 10 messages at a time, making you spend 5 minutes scrolling constantly to find a conversation from a few months ago?

Teams would even lose my messages completely from time to time. It was honestly hard to believe how janky it was.