HN user

rbdn

131 karma
Posts6
Comments14
View on HN

I’ve also hacked bigger voting buttons (for the sake of Fitt’s law [1]) and some indentation marks [0] which I find quite helpful, both included with ~/.js [2].

[0] https://i.imgur.com/Bp3ra28.png

[1] https://en.wikipedia.org/wiki/Fitts%27s_law

[2] https://github.com/defunkt/dotjs

    td { vertical-align: top }
    td > img { background: repeating-linear-gradient(to right, rgba(0,0,0,0), rgba(0,0,0,0) 38px, rgba(0,0,0,0.3) 38px, rgba(0,0,0,0.3) 40px); margin-top: 4px; height: 12px!important }
    div.votearrow { padding-bottom: 3px; background: url('https://i.imgur.com/UVPQXRX.png') !important; width: 20px!important;}

Publishing and peer-review is one part of science, but you are missing an equally important one, which is coming up with (hopefully testable) hypotheses.

But how can you have something testable about something that does not exist yet? You would have to have evidence that an actual, intelligent program does something hostile, which is obviously impossible at the time since AGI has not been invented yet.

However, we do have evidence of naturally occuring hostile intelligence. If an AGI is vastly superior in some regards (for example through much tighter integration in knowledge and control systems), it could in fact pose a danger. The article even clearly states a hypothesis: "Humans, who are limited by slow biological evolution, couldn't compete and would be superseded."

We can’t really assign a probability of occurrence to scenarios like these, thus we have to include it in the list of events that could potentially wipe us out and which we may be able to prevent. Since people are actively working on AGI, it should probably be somewhere at the top where nuclear warfare, global warming and comet impacts are listed.

It seems irrational to make such a prediction about systems which we don’t understand at all.

It’s not clear how sophisticated a neural network needs to be in order to yield AGI. It could be very simple (then you would be wrong with high probability), or it could extremely complex (then you would be right with high probability).

Why is this submission not on the front-page anymore? Was it removed by the moderators? Or were there too many comments in a short amount of time? Too many killer arguments? This seems like an important topic to discuss. I don’t get it.