Experts pledge to rein in AI research

http://www.bbc.com/news/technology-30777834

by ohaal • 12 years ago

39 68 12 years ago

bbc.com

rndn7• 12 years ago

This was discussed two days ago: https://news.ycombinator.com/item?id=8870456

jheriko• 12 years ago

This sounds like a publicity stunt...

My real concern with all of this is always the uncontrolled ecosystem of steadily evolving viruses and malware. We will never have control of that... and there is no telling what it can become in the future.

I think it will be a simple error induced by some random mutation in one of these malicious progams, not some vast artificial intelligence, that causes us problems in this arena first.

drcomputer4• 12 years ago

We need more AI working in the domain of computer security. Stuff that learns under specific guidelines to restrict computational behavior, given specifications of expected behavior.

jacquesm• 12 years ago

You'll have AI working the other side of the arms race just the same. Tools aren't just used by the good guys.

maaaats2• 12 years ago

I wonder: Why should we care about what Musk and Hawking mean about AI? This article doesn't mention too much bad stuff, but earlier they have said that we should be afraid of AI/singularity.

With my thesis now in AI, I probably know far more than those two about this. And we're sooo far away from AI being a superforce destroying mankind.

rndn7• 12 years ago

You can probably assume they are in contact with the leading experts in the field. From the letter:

    The initial version of this document was drafted by
    Stuart Russell, Daniel Dewey & Max Tegmark, with major
    input from Janos Kramar & Richard Mallah, and reflects
    valuable feedback from Anthony Aguirre, Erik
    Brynjolfsson, Ryan Calo, Tom Dietterich, Dileep George,
    Bill Hibbard, Demis Hassabis, Eric Horvitz, Leslie Pack
    Kaelbling, James Manyika, Luke Muehlhauser, Michael
    Osborne, David Parkes, Heather Roff Perkins, Francesca
    Rossi, Bart Selman, Murray Shanahan, and many others.

herewego• 12 years ago

> And we're sooo far away from this being a problem.

If we're far away from this being a problem, we may be far away from understanding how to solve it. We certainly wouldn't want the former to outpace the later, given what is at stake.

DennisP• 12 years ago

They aren't the only ones who signed it, they just get top media billing because they always do. Other people who signed include AI researchers. Peter Norvig, for one.

ThomPete2• 12 years ago

I haven't read your thesis but does it take things like exponential progress, deep learning and higher and higher privileges and control over infrastructure into account?

It doesn't have to be conscious to be dangerous.

Beltiras• 12 years ago

AI would, and should, succeed human intelligence properly implemented. We are nowhere near even understanding it as a problem, much less solving it. I attended an AGI conference a couple of years ago (summer of 2012 iirc). The general feeling was that we are still a lifetime away from a solution.

bsaunder2• 12 years ago

"In the short term, this could mean research into the economic effects of AI to stop smart systems putting millions of people out of work."

This seems unfortunate and somewhat challenging to do. Our current economic model encourages improving efficiency of systems. This seems like a good thing. Its really too bad that people "need" jobs. Jobs should be creating value or they shouldn't exist. Artificially "creating" jobs to prop up the systems feels like fighting against reality and a bad long term plan.

bulletsvshumans• 12 years ago

How about a tax on AI that goes towards unemployment benefits of some kind?

maaaats2• 12 years ago

But what is "AI"? Once something in AI gains traction, it quickly becomes part of the standard computer-science-toolkit.

For instance, programmatically tuning some variables can be considered a standard task, either with some bruteforce or a small search between the possible combinations. This was earlier considered AI, but is now a common approach. AI now would probably be to do more advanced problems with genetic algorithms or similar. But where to draw the line?

rndn7• 12 years ago

I think, the perceived danger here is more the lack of social acceptance of unemployed people. I think however, that if a large part or even a majority of the population is unemployable it will necessarily lead to social acceptance. People will simply have a lot of leisure time.

3beard• 12 years ago

I don't understand why AI eliminating jobs is considered a problem. If any job can be done by a computer program it simply means that humanity has outgrown this kind of work and that nobody should do that mindnumbing crap anymore. Let's forget that the word "computer" used to mean "guy who sits in an office of an accounting firm, and adds numbers all day long".

lukasm2• 12 years ago

Money is not the only problem. Unemployment leads to loneliness, demotivation, social stigma. This is not only caused by social pressure to have a job. Even rich people work. We need some form of Minimal Activity.

The letter will have no effect. Similarly, you can sing a letter to stop drugs.

JulianMorrison• 12 years ago

The idea of work, money and paying for things is obsolete and becoming dangerous. It needs replacing with a non-awful allocation economy.

kylebrown2• 12 years ago

What are the better alternatives for allocating resources? Any distribution mechanism will need a standard metric for measuring and dividing piles of resources. Money is that metric.

I do agree with you about work though. Assuming a future government structure similar to our current one, a humane economic policy will probably need to provide some form of universal basic income.

marknutter• 12 years ago

How then do you propose we assign value to things?

IgorPartola• 12 years ago

We are now entering a new age where our current form of capitalism will not work. You see, when there was enough demand on the workforce (as in, there was as much or more work to do than there were workers), things worked reasonably well. Now we are entering an era where there is much less demand for workers, yet we are not yet productive enough to just sit back, relax, and let machines handle 99.9%+ of the work.

Think about it: 50% unemployment is terrible. 100% unemployment is not unemployment. It means there are enough resources to go around that nobody has to work. There is so much food, shelter, and entertainment that we don't need to get up in the morning and go to work.

Obviously, 100% unemployment cannot happen. In all likelyhood, we'll still need doctors, chefs, artists, etc. But that the direction we are going in, and we better figure out how to set up a new economy to adapt to the new realities.

I envision a shift in the mind set. Personally, if I have more money then I could spend in a lifetime, and choose to work to make myself even richer, I don't care if 10 other families are living off my wealth. People will have a choice: do something productive for society, and live a slightly better lifestyle, or pursue more personal fulfillment. We'll see a lot more artists, and a lot less custodians. In the long run, I believe this shift will be a good thing, but it will require us to stop using terms like "moocher class".

john_b• 12 years ago

Austrian economists like to point out that human wants and needs are effectively infinite (mostly due to the "wants" part), so there is fundamentally no reason that our economy should cease functioning just because the "needs" portion becomes increasingly automated and efficient.

The problem is getting people to pay for the "wants" part. I'm worried that the internet has accustomed people to treating creative content as a free resource by nature of being on the internet. It's the most efficient distribution mechanism for a lot of creative works, but the economics of an ad-filled internet experience with the user as product is very disturbing on a grand scale.

The whole dream of economic progress since the Enlightenment was that our needs would become increasingly solved so that we could focus on what we really enjoy as human beings. To quote John Adams:

"I must study politics and war that my sons may have liberty to study mathematics and philosophy. My sons ought to study mathematics and philosophy, geography, natural history, naval architecture, navigation, commerce, and agriculture, in order to give their children a right to study painting, poetry, music, architecture, statuary, tapestry, and porcelain."

But we live in a world with an ever expanding supply of people and a rapidly diminishing set of "necessary" jobs. If we want to avoid the end game of that situation (revolution) we need to find ways to get the economics of the unnecessary-but-still-valuable to work.

ThomPete2• 12 years ago

I agree with you to some extent but I am not sure the professions you mention are actually as safe from automation as they might seem.

For instance a radiologist who has a very long education behind them and make $300K is in bigger risk of being replaced by image recognition software than a house cleaner.

With regards to art music is being made in large parts by machines and we are now at the point where humans can't hear the difference between a piece of music made by humans and machines.

CornishHen• 12 years ago

I agree that there's a benefit to making processes more efficient by replacing human labor with AI where possible, but I interpreted this to refer to systems that have wide economic effects, like robosigning foreclosures or selling company stocks.

bsaunder2• 12 years ago

Consider the wide economic effect of self-driving cars (once finally highly reliable). This one application of AI could almost single handedly push us over the edge.

The job decimation will be huge: truck drivers, delivery drivers, taxis, bus drivers, automotive insurance industry, traffic enforcement, collision repair shops, emergency services, car sales, car manufacturing (less accidents more vehicle sharing).

I'm sure it will create a few new job types, but a couple of orders of magnitude less jobs than the destruction. Hopefully the world considers this a good thing.

Honestly it seems that most people are too ignorant to see economic pain this will cause until it has happened. Unfortunately, I'm sure unions and industry groups see this train coming and will put up road blocks (pun intended) to delaying an inevitable roll out of the technology.

brador• 12 years ago

So long as we can pull the plug or disconnect the interfaces we'll be ok with AI. Once we can't, then we have a problem.

In effect the scariest AI is distributed, self propogating and can't be unpowered. Effectively a virus. I have yet to see a meaningful distributed AI, even in concept.

Cakez0r• 12 years ago

But it's not inconceivable that in the near-future an AI could train itself to mutate (even if this means interfacing with mechanical turk or freelance websites and paying humans to do it).

faizshah2• 12 years ago

I don't know much about the philosophy of AI and I'm only familiar at a basic level with modern AI algorithms. From what I have been exposed to I don't see any reason to think AI is any more than a set of statistical frameworks. Is there any reason to believe that these statistical frameworks are comparable to biological intelligence?

Am I thinking about this the wrong way?

harshreality• 12 years ago

It sounds like you're talking about the kinds of AI in use today? That's not what the cautions are about, since current "AI" however good at reading individual words or flying drones is not yet capable of human-level thought. The cautions are about trans-sapient AI, which doesn't exist yet. Even if it's simply a beefed up "set of statistical frameworks" linked in the right way to get a computer behave like a human, humans develop and use nuclear weapons, humans go on shooting sprees, humans decide to go to war...

faizshah2• 12 years ago

I see, I didn't think about that. So you mean AI that are not necessarily intelligent or conscious but are just more integrated in our lives, for example in the military or law enforcement?

I can see how a bug in those kinds of systems could cause things like that without necessarily being conscious or intelligent.

marvin• 12 years ago

In this context, the term "Artificial Intelligence" refers to a man-built emulation of the physical process that allows humans to reason and shape the world around us in pursuit of our goals. This hasn't been achieved yet, but humans are proof that it is physically possible. (And through evolution, which is not a strongly guided process).

Unless you believe there is something inherently special and unique about humans that make it impossible for this physical phenomenon to be replicated artificially, there is absolutely something to worry about here.

amelius3• 12 years ago

Why not do the same with all of technology?

Why do shareholders of big corporations profit from science in a grossly non-proportional way, while more than 50% of world's population has to live on under $2 a day?

It is time for the world's greatest minds to start thinking about how to fix capitalism, because it seems to be seriously broken.

And we need it fixed more than we need e.g. iPhone 7.0, or Google Adwords 2.0.

tljr• 12 years ago

Wow. Went strait to 11 there didn't you. Though I must say, I can't disagree with any particular point.

mseebach• 12 years ago

Yes! So broken! Must fix now!

http://www.economist.com/news/leaders/21578665-nearly-1-bill...

blfr• 12 years ago

Coming from a formerly communist country, I have a severe distrust towards "great minds" with some radical fix for capitalism.

Actually, we should start treating social fixes like we do technical rollouts. Prove it on a small scale somewhere first, and then carefully expand.

This seems like common sense. Yet for some reason changes in policies tend to be sweeping, national or even international.

kylebrown2• 12 years ago

Clinical medicine is a better analogy than technical rollouts. But you're right, modern development economics argues that social fixes (policies) should be empirically driven using evidence-based randomized control trials.

Esther Duflo has pushing this approach at the MIT Poverty Action Lab. The main insight is to reject grand generalizations and broad theorizing. Sitting in an armchair pondering how to "fix capitalism" is unlikely to lead to useful lines of thought. Society is too complex a system, cause & effect relationships can be highly localized and context-dependent; formulaic thinking just leads one down ideological rabbit holes.

FrojoS• 12 years ago

Well, in an old school way thats already whats happening. We have many countries on this planet (UN recognizes about 200) and some of the most modern are actually a collection of smaller states organized in a federation. USA, Germany, Switzerland etc.

In fact, you guys had the unfortunate role to find out how well USSR style (I assume) communism works.

delinka3• 12 years ago

If "shareholders of big corporations" aren't going to see the monetary benefits, then why would they even pursue the research?

Put another way: if the financial beneficiary of increased efficiency is NOT they who invested, why would those investors make the investment?

amelius3• 12 years ago

Perhaps you missed the word "non-proportional" (=disproportionate)

saalweachter• 12 years ago

I'm glad someone is finally addressing this, what with a major advance in artificial intelligence being only five or ten years away.

sigzero• 12 years ago

People make mistakes. That is all.

walterbell3• 12 years ago

Research into AI, using a variety of approaches, had brought about great progress on speech recognition, image analysis, driverless cars, translation and robot motion, it said.

How much of this progress required training data generated by working humans? What would feed future statistical algorithms if this source of training data was greatly reduced?

Experts pledge to rein in AI research

Related Stories