Do Neurons Count?
It is necessary to note that such “neural computers” do not execute typical machine instructions of digital computers, unless they are made to emulate the behavior of physical neural networks.
In principle, the basic processing operation performed by every processing element is an analog operation, or transformation of its input signals
Kohonen 1988
John and Sam are talking aboutĀ the following article:
Neural computation
In this post the dialogue is realised by an interaction of virtual characters, for more information please check the page “Virtual characters“
John
I remember Julia reporting about that, but Iām not entirely clear on how that is connected to this and neuromorphic computing
Sam
OK, so think of old-fashioned scales: the bigger the weight, the more the needle moves, right? š
John
Sure, but is that a computation?
Sam
If you think about it: yes it is ! š
It is certainly information processing: it converts one magnitude into another. Or take a thermostat
John
Ah, yes, I know that it is the favorite example of some cognitive scientists for information processing š
Sam
There you go: temperature acts on a sensor which then does something, like turning on the heating.
How do you think the human body does that?
John
You do have a point there … I suppose that at a very basic level they work the same
Sam
That is indeed my point: you need to understand the basic level before you can appreciate what large nets of neurons can do and why that is and isnāt something special
John
Fine! Itās OK, š
I think we can get the readers on board with this, if indeed it is going somewhere more or less familiar or expected.
Sam
Sure, we all know where this is going to go, but if you donāt see why one neuron already computes, then a neural network will just seem like voodoo
John
So we have very simple systems in our body, which are similar to simple analog computers, and therefore we can speak of neuromorphic computing?
Sam
Yes, because those simple analog computers and circuits are the basic building blocks for the much more complex artificial neural networks
John
Alright then! It is good to make that connection very explicit …
Sam
Certainly. The main point is that most computations arenāt like doing math on a blackboard, but so to say implicit
John
So while you are moving your arm to hit the tennis ball and the sunflower is tracking the sun, theyāre not ācrunching numbersā as such, you mean?
Sam
Exactly, but it is still computation and it is part of a causal chain that makes stuff happen. Thereās definitely rules being followed
John
I think an example would be very helpful here …
Sam
Ok, think about steam engines: they had these big metal balls mounted on a valve. The faster they turned, the more they closed the valve (Centrifugal governor)
Sam
in effect they continuously monitored and regulated the pressure. These were called āgovernorsā and the example works exactly like the case of the thermostat
John
Oh, wow, thatās so cool! š¤
I never realized what those rotating ball thingies were meant to do!
Sam
You can totally compare them to neurons too: as soon as a some impulse exceeds a threshold, it elicits a response (Artificial neuron)
ā¦ Continue reading our conversations that are posted every Monday ā¦
Related post
Total posts on the argument
What is AI compared to the hand that wields it?
It suddenly started drawing – in a naturalistic style. Yesterday I was watching it whizzing around, and the result really did look almost like you. That’s when I threw it away…
Anything is art if an AI says it is
Do not you understand? This is a whole new dimension, even according to the canons of the classical “art sacre”. This is a real revolution. Do you understand, ladies and gentlemen? This is the first hot plastic artwork! You! You! My boy … you are an artist!
Sketchy AI
“Young man, you don’t think I’m encountering constructive symbolism for the first time, do you? “Unplug”: free yourself from physicality, from the vulgar earthbound physicality, from the evils of civilization, from electricity, nerves, and so on. Isn’t that what this is? The association is crystal clear, Iād be tempted to say, perhaps even too obvious” (Kishon 1987)
AI see, AI do
You young badgers imagine that it would be enough to smear a pound of paint on the canvas and youāre already a modern painter. I would be willing to accept this abomination for a bad joke, if there was even the slightest humor behind it. But this here is an abracadabra! A nothing!
As far as AI can see
The case of the use of the abacus by Japanese school children and adults … tool’s use becomes incorporated into a culture-specific technology
All aboard the Spike Train!
The experimental results from neurobiology have lead to the investigation of a third generation of neural network models which …
The Network is the Message
A continued stimulus, such as a state of tension, a light or a sound, produces a continued passage of sensory impulses to the central nervous system.