Human brain has more switches than all computers on Earth

http://news.cnet.com/8301-27083_3-20023112-247.html

by cwan • 16 years ago

82 31 16 years ago

news.cnet.com

tectonic• 16 years ago

Computational Neural Networks are getting further and further from the reality of their inspirational biological models. It'd be interesting to see some of this physiology research transition into revised computational models.

pavs• 16 years ago

There's more than one way to skin a cat.

By design Evolution is not perfect, which suggests there are better ways to create AI. To me it seems that trying to replicate how our human brain works is a wrong approach.

On the other hand, there is no reason why we cannot replicate human brain design if we wanted to[1]. Evolution had millions of years and we are just getting our hands wet.

[1]http://www.bbc.co.uk/news/technology-11734909

_delirium• 16 years ago

AI is also not always about building a human out of silicon, but about building something that is in some specific ways better (albeit much worse in other ways). For example, we ideally want to understand what it's doing and why, something we so far understand fairly imperfectly for humans. We also want to be able to control it fairly directly and reliably--- a society of AIs that you have to herd like cats and coax into doing what you want isn't quite what most engineers looking to plug in intelligent modules into their systems are looking for. We also want it to be very reliable and fast at tasks that humans do poorly or get bored doing, like scanning huge quantities of data to find patterns.

At least, that's how it looks from an engineering side. If the end result is that all you get is a human, well, we already have humans; just hire them instead. From a philosophical and technical side creating artificial humans does still remain quite fascinating.

mrb• 16 years ago

The title and article are not clearly written IMHO. What they mean is that the brain has more molecular switches than the number of transistors (switches) of all computers. Some numbers:

  * 1.25e14 synapses in a brain
  * they discovered each synapse has 1000 molecular switches
  * so 1.25e17 molecular switches in a brain
  * a post-2005 CPU has 1e8 transistors or so (2010 CPUs barely hit 1e9 transistors)
  * I estimate 1e9 computers on earth
  * so 1e17 transistors in all CPUs
  * 1.25e17 > 1e17 so the statement is right

pygy_2• 16 years ago

There are 1.25e14 synapses in the cerebral cortex.

The total number is higher still (the cerebellum is heavilly wired too), but I don't know by how much.

a-priori• 16 years ago

According to Wikipedia[1], citing [2], the human brain has 'as many as' a quadrillion (10e15) synapses. I presume this includes the entire central nervous system (including the cerebral cortex, cerebellum, and subcortical structures).

[1] http://en.wikipedia.org/wiki/Human_brain

[2] http://www.ncbi.nlm.nih.gov/pubmed/8527499

Edit: I just skimmed that paper, and it doesn't look like a reliable source. It's an estimate based on a mathematical analysis, and the authors say "We emphasize that these conclusions are preliminary, based as they are on an incomplete database and simplified models of the brain". I also don't see where the Wikipedia article gets the 10e15 number.

AngryParsley2• 16 years ago

While comparing apples and oranges, they neglected to mention the speed of the "molecular switches." The fastest neurons fire at around 200Hz. Most fire at around 20Hz. Transistors are around 100,000,000 times faster.

Oh and circuits conduct signals at 0.5c while neurons are lucky to go at 0.000001c (300 meters/sec).

Shorel• 16 years ago

This really puts the book 'True Names' in perspective.

May be the mailman could be a fast thinker.

phlux• 16 years ago

True, but our brains absorb massive amounts of information and process it in parallel whereas it is much more serial for computers.

pointernil• 16 years ago

I think the number of neurons should not be missed in those calculations.

pmiller2• 16 years ago

This deserves a few more upvotes. There's some ongoing research to determine the role glial cells have in that wonderful computation we call "thought." See, for example this interview: http://www.scientificamerican.com/article.cfm?id=the-root-of... .

marze• 16 years ago

Take that, Mr. Kurzweil.

iandanforth• 16 years ago

Having read the original paper I can tell you a couple things:

1. The technique used to visualize synapses is awesome. 2. This quote about molecular switches comes out of nowhere. It's related but not really part of this study.

More importantly though the idea that these are switches and that there are way more of them than transistors in the world misses two important points.

1. Are the molecular switches relevant to the computation performed by the brain?

Only in so much as to build a transistor you need materials with certain specific properties, and to build a calcium channel you need proteins with certain specific responses to the environment. Comparing the computational unit of one to the building blocks of another isn't quite accurate.

2. Even if they were computationally relevant are they comprable in terms of key metrics like performance?

Two important things to remember about the brain are that its slow and very very efficient. Silicon logic on the other hand is very very fast and inefficient. Even if there were a thousand fold increase in the number of computational units assigned to the brain the processing speed of a modern transistor decimates synaptic level computation.

roel_v2• 16 years ago

"...about the brain are that its slow and very very efficient. Silicon logic on the other hand is very very fast and inefficient..."

Can you elaborate? In what way is the brain efficient in a sense that a transistor isn't?

pygy_2• 16 years ago

In the energetic efficiency meaning of the word.

The energy consumption of the brain is around 20W in an adult human.

Compare that to the multi hundred Watt consumption of the meager machine you're reading this on...

raphar• 16 years ago

Wow, a mouse genetic engineered just to make certain bigger neurons (but not all of them) to emit a green glow. One can do that!?

charlesju• 16 years ago

I think the REAL question we're all wondering is when we will have access to a super computer with the capacity of the brain IF we follow Moore's Law.

powrtoch• 16 years ago

I don't think this question is well defined enough to be meaningful. In terms of how quickly it can carry out complex calculations, low end modern laptops leave your brain in the dust. What few functions the brain can still claim any advantage on are the result of dedicated wetware and our ability to learn and thereby specialize software. Computers will get there, but it's not really a Moore's Law problem.

The title of this article should not be misconstrued to mean that the brain is a more powerful computation device, only that it is more complicated.

randallsquared• 16 years ago

I don't think this question is well defined enough to be meaningful.

You can certainly get closer than asserting that, e.g., a hand calculator is more powerful than a human brain because it can do 7 digit long division almost instantly.

At some point, we'll have computers powerful enough to run a working simulation of a human brain. Shortly before that, there will be a point when computers of that sort are "as powerful as a human brain", though we might not realize it when that happens if the software lags.

So that's an upper bound on charlesju's question.

Udo2• 16 years ago

Low-level neurological concepts like synapses do not translate well into (low-level) computer terms if you do it by force instead of by reasonable consideration. A synapse is not a switch. A neuron is neither a simple weighted node nor is it an 800 MHz signal processing device with gigabytes per second of throughput. By going arbitrarily deep into the biochemistry, people could (and probably do) come up with ridiculous numbers. For example, maybe somebody wants to count and represent all the macromolecules in a neuron that modulate its function. It's easy to come up with an arbitrarily large number and land a nice gig on CNet for it.

arethuza3• 16 years ago

When I was working on AI research in the late 80s and 90s (on the symbolic reasoning side of things) I got the distinct impression that Artificial Neural Networks were really just a nice statistical technique that had a marketing breakthrough - they really appeared to have very little to do with exploiting the behaviors found in actual brain cells.

Udo2• 16 years ago

Artificial neural networks do work well as a model of behavior of biological neural nets, up to a point. They are definitely a piece of the puzzle, a module to duplicate a certain type of information that is represented in biological brains. When they became suddenly famous in the 80s and 90s, the mistake was to assume we could build everything, including an artificial mind, if we just had a large enough neural net. That was essentially the IBM approach: just throw enough resources at it and it will become intelligent. Turns out, more is needed for building actual intelligence.

I firmly believe that neural nets and other techniques are still essential components needed for implementing artificial minds. We now know that processing power and storage space are alone are not enough, a brain needs actual software that tells it what to do with information and how to organize itself. That's essentially how I became very skeptical of the kind of brute force AI research that is being conducted today. For instance, modeling a synapse chemically down to the atomic level is nice for basic research, but it's definitely not the way to implement AI. For this, we need larger abstractions that are functionally equivalent and translate well into efficient computer code, and we need to figure out how to make these pieces of code interact with each other in a meaningful way. My wild guess would be that today we're not even constrained by computing power or storage needs, we just lack the correct design.

akeefer• 16 years ago

There is, however, now a company called Numenta that's working on AI using structures they call Hierarchical Temporal Memory that are, in fact, based on trying to model the sort of structures actually found in the brain.

http://www.numenta.com/for-developers/education/general-over...

mdda• 16 years ago

I was also working in AI in the late 80s and 90s, but in a lab that loved the neural network side of things. I decided pretty quickly that the biological inspiration for NNs was more marketing than useful. The more interesting developments were being done with Bayesian stuff (at least there was a mathematical theory behind the performance).

FWIW, I ended up doing my PhD on Genetic Algorithms / Genetic Programming : where the biological inspiration (and understanding) works both ways (IMHO).

badave• 16 years ago

Hehehe, and 83% of brains are only used to watch porn...

Human brain has more switches than all computers on Earth

Related Stories