johnaspden

Programmers will be replaced by whatever the superintelligence makes out of their atoms.

Fancy a fuck? Fancy a fight? My tree! My tree!

JPI Modula-2 was my first proper compiler on my childhood PC! I loved it, it was nicer to use than either Turbo Pascal or C.

I actually bought my first ever hard disk (a mighty 10MB as I remember, more storage than I'd ever be able to use), for something like £200, an absolute fortune to an adolescent in 1986, just so that I could install modula-2 permanently in the machine and could stop swapping compiler floppies and program floppies all the time.

But when I first got access to UNIX boxes as a postgrad there was C but no Modula-2, so I switched to C, which could do everything Modula-2 could do except it was a bit more fragile and treacherous.

Who cares? And how would we tell?

Apparently not. And I am slightly surprised by that.

Oh God, yes! I'm old enough to remember when people thought it was important to have quiet and privacy to think.

I used to love my job. All my life I've loved programming, and I used to love being able to solve other people's problems for them by doing the thing I love.

And I used to love being surrounded by other people who were interested in the same things as me, all collaborating on a project to make something useful.

The open-plan curse killed it for me. For years I've done as little paid work as I can get away with because I hate trying to think in an open-plan horror so much. It's like having my brain in a blender.

I still program, and think, a lot, but I only do it for other people when I need the money.

Christ, this is supposed to be for people with no spoons, and yet one of the recipes is: "Peanut Butter On A Spoon". Could they not be bothered to get someone to proof read it?

Presumably he doesn't care. How's his poetry?

He gets a standing ovation at the end, which is nice to see.

Apparently this was released by accident and the youtube copy has been set to 'private', but luckily some quick-witted person downloaded it and has put a copy where it can be found.

I made a copy of that with:

$ wget https://files.catbox.moe/qdwops.mp4

and I'd be happy to stick that somewhere if this one disappears.

Just in case anyone needs to be reassured that this is a thing that can be believed by at least two people, I endorse what he's saying here wholeheartedly, and I don't think we've got very long left at all.

Timescales are the dodgiest bit of this whole argument, and all we have is intuition, but I'd be absolutely amazed if humanity still existed in ten years time, and pleasantly surprised if we make it to the end of this year.

To learn CNNs at the deep-dive level you need calculus, at least differentiation and integration.

Oh the poor dears, imagine needing schoolboy maths to do science.

Am Eliezer disciple, can confirm.

Back in the day when Eliezer was optimistic about AI (there's a reason why the SIAI/MIRI logo looks like an angel), I wrote him a very silly e-mail warning him that, despite being Jewish, he was falling for the Christian rapture narrative in a new form!

It seemed to me that his ideas, which I think are all correct, straightforwardly implied the destruction of all things, with very little hope.

I bite that bullet, and I always have.

Over the years, Eliezer has lost all hope, and things have happened much faster than either of us thought they would, and now he's making one final roll of the dice, burning his reputation by saying out loud what he thinks, in the hope that someone might listen.

I'd be very surprised if he thinks this will work. He's trying to get a warning out to the general population, in spite of this meaning that no one inside AI will ever trust him again. He thinks it no longer matters.

Me too.

I want to say that I completely endorse this. The whole thing in all its details.

I don't have any reputation to sacrifice, and I don't expect my endorsement to convince anyone, but I want to set a precedent that it's ok to believe this.

It's true, as far as I can see. And I've been thinking about this for something like fifteen years.

And if other people who think it's true are ashamed to say it out loud, then I want to let them know that at least one other person on the planet has said so too.

It doesn't need any reason to hate humanity. It just needs to not care about us.

No one has an interest in playing this game at all. It is a bad game.

Like the First, Second, and Third World Wars, the winning move is not to play.

Amazing how people who would never hurt a child seem to have no problem with building things that kill all the children.

Yeah, I'm not keen. But I'm old, and it wouldn't be so bad. I'm mainly about not killing all the children.

Almost no one thinks they will. The worry is that they're the last piece of the puzzle, and that we're very close to having all the parts for the real thing.

Not unless they managed to solve their own alignment problem, and they're friendly. Otherwise we'd already be dead.

And about 8000 science fiction novels. And the fact that an idea is obvious to a child does not mean that it is not true!

As a long term Yudkowsky-fan, I confirm that this tallies roughly with my recollections of his serious work. I don't know how much of a hand he had in 'Logical Induction'.

It's definitely his style and his research program, but I think that (wonderful) idea was Scott Garrabrant's own.

I think it's fair to say that he is not an Orthodox Jew.

We want to change everyone's gender, as often as possible; and will devote superhuman resources to spreading this philosophy over as much of the available future lightcone as physics permits.

Those whom the gods wish to destroy, they first make mad.

In legend, Paul Morphy learned in this way.

It'll keep until tomorrow.

I was just thinking, I wonder where I can get me a Toblerone.

Emulsified High Fat Offal Tubes 237g 40% sawdust 20% water 20% mechanically recovered abbatoir floor meat 19% rapeseed oil 1% unpronounceable chemicals

And do they call me 'Dai the boat-builder?'

Y'all remember about ten years ago, when there were all those weirdos worrying about this sort of thing?