In terms of order of magnitude, how does a the energy consumption of a typical mammalian neuron (in the brain) compare with the state of the art MOSFET?
-
16$\begingroup$ I’m voting to close this question because you cannot compare a MOSFET with a neuron in a meaningful way. It's like comparing apple pie with whiskey - they do different things and are for different purposes with different goals. $\endgroup$– StephenG - Help UkraineCommented Oct 20, 2021 at 2:26
-
10$\begingroup$ @StephenG The OP isn't asking to compare the purposes or goals though. e.g. You can still compare the calorie content of both the apple pie and the whisky. $\endgroup$– BioPhysicistCommented Oct 20, 2021 at 2:28
-
16$\begingroup$ @StephenG Please don't twist what I'm saying. I'm definitely not saying all comparisons are on-topic here. I am not even defending this question really. I was only referring to your comment. Yes, neurons and MOSFETs are different, but technically one can still compare their energies. That's all I was saying really. Whether or not this question belongs here is a different discussion; it's not a nonsensical question though. $\endgroup$– BioPhysicistCommented Oct 20, 2021 at 3:56
-
3$\begingroup$ Power consumption comparisons seem to me to be a legitimate physics exercise. I think the only major issue with the question is actually just the efficient-energy-use tag, as there is no metric for "efficiency" given for either of the objects under comparison. $\endgroup$– João MendesCommented Oct 20, 2021 at 8:38
-
4$\begingroup$ You can compare their power consumption, but you can't compare their efficiencies, and the power consumption means very little. Imitating a neuron would require a complex circuit with multiple transistors, while it takes a complex neural network to solve problems frequently handled with simple transistor circuits. (And of course there are other problems that transistors can solve but neurons just aren't useful for, such as power switching.) $\endgroup$– Christopher James HuffCommented Oct 20, 2021 at 18:14
6 Answers
Not surprisingly, it isn't so easy to get the power consumption of a cell. What is the power consumption of a cell? makes various estimates. One estimate for a human cell is
$$P_{cell} = 3 \cdot 10^{-10} W$$
When you read it note that power is measured either in Watts or ATP/sec. ATP, or Adenosine TriPhosphate is the molecule that stores energy in cells. An ATP is the amount of energy liberated by removing a phosphate group.
As Martin Modrak pointed out, the brain has $2\%$ of the body's mass, but uses $20\%$ of its energy. The neurons use $80\%$ of this $20\%$. I will estimate that the brain is $25\%$ neurons. That means neurons use roughly $32$ times more energy than a typical human cell, or
$$P_{brain \space cell} = 10^{-8} W$$
More surprisingly, the power consumption of a MOSFET isn't as simple as you might expect. And not all MOSFETs are created equal. Some are intended for high voltage switching power supplies. Guide to MOSFET Power Dissipation Calculation in High-Power Supply gave an example power supply where the dissipation is $1.23 W$.
But you are probably thinking of a transistor used in a computer. I found an unsupported rough estimate in If every transistor in a modern CPU was replaced with an old vacuum tube, how much power would that CPU take? that the power of a transistor is
$$P_{transistor} \approx 10^{-7} W$$
As Joao Mendez pointed out, power consumption is directly related to clock speed. This is because most of the power is used while switching between 1 and 0. This is the limiting factor of clock speed. Too much power consumption means raises the temperature of the chip too high, even with good cooling. Also, for mobile devices, it drains the battery more quickly.
Keep in mind that a brain and a computer achieve immense computing power in completely different ways.
A typical computer might use $10^{10}$ MOSFETs in the CPU and GPU, and > $10^{11}$ in a large bank of RAM. A typical clock speed is > $10^9$ Hz. It might run hundreds of threads "in parallel" using $\approx 10$ processors. From Transistor count,
On the other hand, a brain has about $10^{11}$ neurons Are There Really as Many Neurons in the Human Brain as Stars in the Milky Way?. It also has about 3 times that many glial cells, Neuroglial Cells. It has what might loosely be called a "clock speed" of about $ 5 - 80$ Hz, What is the clock speed equivalent of the human brain?, and is massively parallel.
MP 2Ring, Joe, and Stephan Matthiesen point out that a neuron has many dendrites, is much more complex than a transistor, and therefore a more powerful computing element. This is true, but a transistor is much faster and can do many operations in the time a neuron can do one.
I have no good way of defining computing power that would apply to both, and much less hope of comparing them. A brain and a computer each can do things the other can't touch. Anything simple, like comparing clock speeds and dendrite counts, is surely misleading.
-
3$\begingroup$ Perhaps add some more info on the relative computing powers of a mosfet vs a neuron, and on mosfet circuits vs neural "circuitry". A typical human neuron has many thousands of input synapses (and can send output to many thousands of others), and the date exchanged at a synapse is generally more complex than a simple one-way transmission of a single bit. $\endgroup$– PM 2RingCommented Oct 20, 2021 at 5:53
-
$\begingroup$ I think it might be worth adding that transistor power consumption in a computer is directly related to clock speed. Other than that, spot on. $\endgroup$ Commented Oct 20, 2021 at 8:39
-
3$\begingroup$ Good baseline! A potential problem here is that neurons are very much not average cells in terms of energy consumption - Wiki (en.wikipedia.org/wiki/Human_brain#Metabolism) claims that brain consumes ~20% of total energy consumption of the whole body while weighing ~1.4kg. Of this consumption, ~80% is by neurons (pnas.org/content/110/9/3549), so this can easily make an order of magnitude or two difference over the consumption of an average human cell... $\endgroup$ Commented Oct 20, 2021 at 8:41
-
$\begingroup$ Also, there's a question if the number of MOSFETs and the number of neurons are the right measures to compare. Each neuron does much more computing than an individual MOSFET as it integrates inputs from many connections, whereas an individual MOSFET is a simple switch. Perhaps better would be the number of synapses in the brain versus the number of logical gates in the computer. $\endgroup$– uUnwYCommented Oct 20, 2021 at 9:10
-
1$\begingroup$ "As Martin Modrak pointed out, the brain has 2% of the body's mass, but uses 20% of its energy. The neurons use 80% of this 20%. I will estimate that the brain is 25% neurons. That means neurons use roughly 32 times more energy than a typical human cell," Are you assuming that neurons have the same mass as the average cell? $\endgroup$ Commented Oct 20, 2021 at 18:43
This doesn't directly answer your question, but I think this article gives a good feel for just how much more complex a single biological neuron is than an individual node in an artificial neural network. In the paper cited in the article, they need a network with 1000 nodes to model a single biological neuron, and even then they say that the biological neuron is probably more complex than this. To compare this to your question you'd need to then have some kind of a measure relating the complexity of a single transistor with that of a node in a neural network; I doubt you can just say that each node corresponds to $x$ transistors, but surely the nodes are a lot more complex.
So, maybe you have some other motivation for asking this question. But if you're imagining the functioning of transistors in a CPU and that of neurons in the brain as being somehow analogous and then trying to make a direct comparison based on this, then I don't think this comparison is very useful.
-
4$\begingroup$ As a correlation to your article: they've recently determined how neurons approximate backpropagation without needing a period of downtime to do it. Obviously a transistor is never going to be able to match that. $\endgroup$ Commented Oct 20, 2021 at 13:58
-
2$\begingroup$ @Ross Presser thanks for an interesting reference $\endgroup$– JojoCommented Oct 20, 2021 at 16:08
The human brain runs on about $12$ watts and has about $90$ billion neurons, for a power consumption of about $10^{-10}$ watts. I wasn't able to find the power consumption of a MOSFET, though.
My Intel Core I5 CPU and the human brain use comparable amounts of energy (order of magnitude: 100W).
My brain has about 60 times as many neurons, as my CPU has transistors.
Therefore, each transistor uses about 60 times the power of a neuron.
This is, of course, a meaningless comparison - a cup of sand has about 15 million grains of sand, and draws no electricity at all, so "uses 100% less power than either neurons or transistors".
Neither a neuron, nor a transistor, has any calculating power on it's own.
Even comparing an entire human vs. an entire computer is meaningless - which is quicker? For making me laugh, a human being is quicker. For making me cry, a computer is quicker :D
Have you noticed that revising for exams, or other intense intellectual work, makes you hungry? The human brain burns up to about 100W. At some jobs e.g. face recognition it is far more energy efficient than computers. At others though e.g. adding thousands of numbers computers win.
-
$\begingroup$ Good thought. I am more likely to get tired than hungry when I think or exercise. But exercise will make me hungry later. When I get tired thinking, I sometimes can think about something else. Sort of like using different muscles. I understand energy use of the brain doesn't change much when you think. How does it change for exercise? $\endgroup$ Commented Oct 20, 2021 at 18:56
You really can't meaningfully compare the energy consumption of neurons and transistors. Quite apart from the fact that it takes a fairly powerful CPU to do a real time model of a neuron (to the degree that we can even model the full complexity of one), they are fundamentally different.
Transistors are electronic devices. They use power only when they are computing something. Shut your computer off, and the CPU consumes zero power. Neurons are living cells: they consume energy just by being alive, in order to be alive in the first place. The energy consumption difference between active thinking and not is miniscule, if it exists at all.
-
$\begingroup$ If your brain used more energy when you think, it would get hot and have to be cooled by blood flowing through it. This would either help you keep warm or make you sweat to get rid of the heat. I haven't noticed either. $\endgroup$ Commented Oct 20, 2021 at 19:00
-
1$\begingroup$ @mmesser314 that is literally how it works! en.wikipedia.org/wiki/Functional_magnetic_resonance_imaging $\endgroup$ Commented Oct 20, 2021 at 19:35
-
$\begingroup$ @Lawnmower Man: The question, though, is what is the difference in energy consumption between a "resting" neuron and an active one? Say for instance neurons in the visual cortex when you're in a dark room, vs processing a complex visual scene. My understanding is that it's somewhere around 5%. $\endgroup$– jamesqfCommented Oct 21, 2021 at 17:14