All aboard the Spike Train!

All aboard the Spike Train!

All aboard the Spike Train!

Experimental evidence has accumulated during the last few years which indicates that many biological neural systems use the timing of single action potentials (or “spikes“) to encode information
These experimental results from neurobiology have lead to the investigation of a third generation of neural network models which employ spiking neurons (or “integrate-and-fire neurons“) as computational units

Maass 1996

Cho and John are talking about the following article: Networks of spiking neurons: The third generation of neural network models

In this post the dialogue is realised by an interaction of virtual characters, for more information please check the page “Virtual characters

Cho

The whole idea of spike trains goes again to show that it’s not strictly analog or digital

Today 15:43

John

I begin to see what you mean

Today 15:43

Cho

A neuron is a very simple thing in that specific respect, but tries to make the most of it

Today 15:44

Cho

Just “on” or “off” doesn’t convey a lot of information, but furiously blinking all the time …🎇 

Today 15:44

John

Yes, like you said, that is like a telegraph, or more akin to code

Today 15:44   

Cho

Maybe, I’m not sure what the best analogy would be on a computational level

Today 15:45

John

So Sam made an analogy to early analog computing where you had rotating discs and balls

Today 15:45   

John

there could respond in real time and were much faster than digital computer back then

Today 15:45   

Cho

That might be an apt analogy, they needed to vary continuously with the stimulus

Today 15:46

Cho

spiking” more frequently with the intensity or orientation etc.         

Today 15:46

John

OK, so reasonable analogy then?

Today 15:46   

Cho

I guess … it is just like I said at the beginning: the questions kinda determine the answers

Today 15:47

John

So I’m abstracting too much? 😅

Today 15:48   

Cho

By imposing the framework of “either analog or digital”, yes  😅       

Today 15:48

John

I’ll try to convey some more nuance in the article then …

Today 15:49   

Cho

That would be nice, but I understand that it is very difficult to convey that to the general public

Today 15:50

John

Sure, glad you appreciate that, but we don’t need to give them the ultimate truth less than 1000 words

Today 15:51   

John

just show them a bit of what is going on, and then keep doing that, keep spiking …

Today 15:51   

Cho

Ha! ha! 🤣 But seriously, perhaps the best analogy for neural communication is human communication 😉

Today 15:52

John

I might use that analogy if you don’t mind! 🤔

Today 15:53   

Cho

Always happy to help!  😊                                                                        

Today 15:53

John

And I’ll be back for more, don’t worry! 😄

Today 15:53   

… Continue reading our conversations that are posted every Monday

1 Star2 Stars3 Stars4 Stars5 Stars (4 votes, average: 4.25 out of 5)
Loading...

Related post

Sketchy AI

Sketchy AI

“Young man, you don’t think I’m encountering constructive symbolism for the first time, do you? “Unplug”: free yourself from physicality, from the vulgar earthbound physicality, from the evils of civilization, from electricity, nerves, and so on. Isn’t that what this is? The association is crystal clear, I’d be tempted to say, perhaps even too obvious” (Kishon 1987)

read more
AI see, AI do

AI see, AI do

You young badgers imagine that it would be enough to smear a pound of paint on the canvas and you’re already a modern painter. I would be willing to accept this abomination for a bad joke, if there was even the slightest humor behind it. But this here is an abracadabra! A nothing!

read more
The Network is the Message

The Network is the Message

The Network is the Message

A continued stimulus, such as a state of tension, a light or a sound, produces a continued passage of sensory impulses to the central nervous system.

Adrian & Zotterman, 1926

Cho and John are talking about the following article:
Ask a Neuroscientist: What’s a spike train?

In this post the dialogue is realised by an interaction of virtual characters, for more information please check the page “Virtual characters

Cho

Yes, it makes little sense to just zoom in on one single neuron         

Today 15:43

John

Information and information processing is distributed over the whole brain?

Today 15:43

Cho

Well, not all of it all the time. Specific pathways and modules exist for specific types of information

Today 15:44

John

Such as the “visual pathway” and stuff like that?

Today 15:44   

Cho

That’s a good example. The retina already detects and filters some signals right at the beginning

Today 15:45

Cho

and then the associative cortex deals with the end product: there’s serial and parallel aspects at all levels.

Today 15:45

John

Ok, so “it’s complicated”, again 😟

Today 15:45   

Cho

I’m afraid so! If I am not mistaken Sam once told me about his artificial neural networks and I was quite shocked at their simplicity

Today 15:46

John

Simplicity? 🤔

Today 15:46   

Cho

Well, it is not just a simplistic model of how a neuron works, but also the networks were organized in a totally biologically implausible way

Today 15:47

John

So they forgot essential features?

Today 15:48   

Cho

More like essential constraints: not every neuron is connected to every other neuron! But that is what a lot of artificial networks do

Today 15:48

John

Oh, right, that is a major difference of course!

Today 15:49   

Cho

Now I think he did tell me that there were new developments, there always are, which organized things in a more reasonable way

Today 15:50

John

I think Sam is working with “spiking neural networks” nowadays?

Today 15:51   

Cho

That sounds promising. People tend to think neurons only fire now and then, but in fact they fire all the time

Today 15:52

John

What do you mean?🤔

Today 15:53   

Cho

It’s not like they send on one impulse and then just sit there, as long as you are hearing the sound, seeing the color, etc. they fire!

Today 15:53

John

Oh, ok, so there’s lots of spikes, not just one big yes or no signal?

Today 15:53   

Cho

Indeed, we normally speak of “spike trains”, more like a telegraphed message with lots of yesses and noes 😊

Today 15:54

John

OK, this is very helpful 😉

Today 15:54   

… Continue reading our conversations that are posted every Monday

1 Star2 Stars3 Stars4 Stars5 Stars (4 votes, average: 4.25 out of 5)
Loading...

Related post

Sketchy AI

Sketchy AI

“Young man, you don’t think I’m encountering constructive symbolism for the first time, do you? “Unplug”: free yourself from physicality, from the vulgar earthbound physicality, from the evils of civilization, from electricity, nerves, and so on. Isn’t that what this is? The association is crystal clear, I’d be tempted to say, perhaps even too obvious” (Kishon 1987)

read more
AI see, AI do

AI see, AI do

You young badgers imagine that it would be enough to smear a pound of paint on the canvas and you’re already a modern painter. I would be willing to accept this abomination for a bad joke, if there was even the slightest humor behind it. But this here is an abracadabra! A nothing!

read more

I’m in your brain, releasing your transmitters

I’m in your brain, releasing your transmitters

I’m in your brain, releasing your transmitters

The mechanism of action of nerve stimulation is unknown. In view of the fact that certain pharmaceuticals act almost identically to the stimulation of certain nerves, it is possible that substances are formed under the influence of nerve stimulation, which in turn successfully effect the stimulation

Loewi 1921

Cho and John are talking about the following article: Introduction to cell signaling

In this post the dialogue is realised by an interaction of virtual characters, for more information please check the page “Virtual characters

John

So an electrochemical signal travels along the axon, that is, along the membrane of the cell itself …

Today 15:43

Cho

Right, and that then triggers chemical messengers that convey information to other cells.                    

Today 15:43

John

And this can happen in various ways too? 😊

Today 15:43

Cho

Yes, that is another form of categorization: what the target is.         

Today 15:44

John

Ok, so depending whom the cell wants to speak to, it releases different chemical compounds?

Today 15:44   

Cho

Something like that. Keep in mind that all cells communicate, not just nerve cells

Today 15:45

John

Please elaborate!

Today 15:45   

Cho

So a cell can target itself, can target its close neighbors, or can target other cells far away.
Today 15:46

Cho

we call that “autocrine”, “paracrine”, or “endocrine” signalling.            

Today 15:46

John

OK, but that’s all done with “neurotransmitters”?

Today 15:46   

Cho

Not really, no. Endocrine signalling is done by hormones                  

Today 15:47

Cho

Cells release a compound into the bloodstream which then affects cells far away, in other parts of the body.
Today 15:47

John

Oh, wow,😳 that definitely something that isn’t normally included in “neuromorphic computing

Today 15:48   

Cho

Nope, I guess not, but it definitely is “information processing” between cells.

Today 15:48

John

We might need to do an article on that sometime … but let’s focus on neurons for now.

Today 15:49   

Cho

OK, indeed the standard case in that context is go/no go based on action potentials

Today 15:50

John

Yes! And for the purposes of computation, we can safely regard those as 1s and 0s? 😊

Today 15:51   

Cho

Up to a point, because cells can excite or inhibit other cells, making it more or less likely they will fire

Today 15:52

Cho

And it more often than not is many to many communication           

Today 15:52

John

What do you mean?🤔

Today 15:53   

Cho

One cell releases neurotransmitters to multiple other cells while at the same time multiple cells affect one cell

Today 15:53

John

OK, so we definitely need to stress the holistic and network aspects😉

Today 15:53   

… Continue reading our conversations that are posted every Monday

1 Star2 Stars3 Stars4 Stars5 Stars (4 votes, average: 4.25 out of 5)
Loading...

Related post

Sketchy AI

Sketchy AI

“Young man, you don’t think I’m encountering constructive symbolism for the first time, do you? “Unplug”: free yourself from physicality, from the vulgar earthbound physicality, from the evils of civilization, from electricity, nerves, and so on. Isn’t that what this is? The association is crystal clear, I’d be tempted to say, perhaps even too obvious” (Kishon 1987)

read more
AI see, AI do

AI see, AI do

You young badgers imagine that it would be enough to smear a pound of paint on the canvas and you’re already a modern painter. I would be willing to accept this abomination for a bad joke, if there was even the slightest humor behind it. But this here is an abracadabra! A nothing!

read more
Come in Neuron: do you copy?

Come in Neuron: do you copy?

Come in Neuron: do you copy?

If we liken the nervous currents to electric currents, we can compare the nervous system below the hemispheres to a direct circuit from sense-organ to muscle

James 1890

Cho and John are talking about the following article:
Action potentials and synapses

In this post the dialogue is realised by an interaction of virtual characters, for more information please check the page “Virtual characters

John

The answer varies depending on the question? In what sense?

Today 15:43

Cho

Well, you were asking about “neuromorphic computing”, so you’re interested in the computational aspects                          

Today 15:43

John

Yes, that’s right. 😊

Today 15:43

Cho

But Sandra, as a doctor, might be interested in completely different aspects of a neuron

Today 15:44

Cho

Like: what is wrong with it, why isn’t it firing, is there damage to the cell membrane, etc. 

Today 15:44

John

Oh, ok, sorry I thought you meant something completely different!

Today 15:44   

Cho

So from a computational point of view, you’d just be looking for information                                 

Today 15:45

John

And since we’re making assumptions we’re missing things

Today 15:45   

Cho

Exactly. If you look for 1s and 0s, you’ll look at the bits that could be 1s or 0s and forget about the rest            

Today 15:46

John

Ha, bits, quite literally 😅 … And that’s why we look at the electrical part?

Today 15:46   

Cho

Yes, a stimulus, a current, something that transmits information    

Today 15:47

John

And what do we miss then?

Today 15:48   

Cho

Hard to know where to begin really … communication between cells isn’t just firing off electrical signals 😊                  

Today 15:48

John

OK, so you mean the chemical aspects of communication between nerve cells?

Today 15:49   

Cho

Yes, how signals spread along the axon and then how that triggers the release of neurotransmitters across the synapse (Neurotransmitter)

Today 15:50

John

I’ll need to include a short dictionary with the article I’m afraid … 😅

Today 15:51   

Cho

That would be seriously useful I think, I just can’t avoid some of the jargon 😅

Today 15:52

… Continue reading our conversations that are posted every Monday

1 Star2 Stars3 Stars4 Stars5 Stars (4 votes, average: 4.25 out of 5)
Loading...

Related post

Sketchy AI

Sketchy AI

“Young man, you don’t think I’m encountering constructive symbolism for the first time, do you? “Unplug”: free yourself from physicality, from the vulgar earthbound physicality, from the evils of civilization, from electricity, nerves, and so on. Isn’t that what this is? The association is crystal clear, I’d be tempted to say, perhaps even too obvious” (Kishon 1987)

read more
AI see, AI do

AI see, AI do

You young badgers imagine that it would be enough to smear a pound of paint on the canvas and you’re already a modern painter. I would be willing to accept this abomination for a bad joke, if there was even the slightest humor behind it. But this here is an abracadabra! A nothing!

read more

Zap goes the Neuron

Zap goes the Neuron

Zap goes the Neuron

If I do not greatly deceive myself, I have succeeded in realizing…
The hundred years’ dream of physicists and physiologists, to wit, the identity of the nervous principle with electricity

Du Bois-Reymond 1848

Cho and John are talking about the following article:
The Principles of Nerve Cell Communication

In this post the dialogue is realised by an interaction of virtual characters, for more information please check the page “Virtual characters

John

Hello Cho, I wonder if I could bother you with some questions? 😊

Today 15:43

Cho

Hi John, sure, what do you need? 😉                                                      

Today 15:43

John

I’m working on an article on neuromorphic computing

Today 15:43

Cho

Well, I’m good for the “neuro” part, but computing …not so much😅

Today 15:44

John

No problem, I already talked to Sam, and the “neuro” part is precisely why I come to you now 😊

Today 15:44   

Cho

Ah, OK then I do think I can be of assistance!                                       

Today 15:45

John

Excellent! Sam really confused me with his talk of analog and digital or continuous and discrete 😣

Today 15:45   

Cho

Yes, that is something that comes up a lot when talking about neurons             

Today 15:46

John

So can you help me with that? What kind of information or signals do neurons exchange?

Today 15:46   

Cho

Let’s start with “it’s complicated”                                                             

Today 15:47

John

I was afraid you’d say something like that …😅

Today 15:48   

Cho

First of all, there are many different kinds of neurons                        

Today 15:48

John

Oh! Yes, I recall we talked about that! “Little big brain

Today 15:49   

Cho

Very good! 😊

Secondly, people tend to focus on the electrical aspect, not on the chemical one

Today 15:50

John

What do you mean?

Today 15:51   

Cho

When a neuron fires, it isn’t exactly the same as flipping a switch

Today 15:52

John

So it isn’t digital or discrete?

Today 15:53   

Cho

Not straightforwardly no, but it also depends on how you look at it?

Today 15:54

John

Is this going to be about quantum and observers and stuff like that?

Today 15:55   

Cho

Ha! No, not at all. 😅 

I just meant that the answer might vary depending on the questions you ask

Today 15:55

… Continue reading our conversations that are posted every Monday

1 Star2 Stars3 Stars4 Stars5 Stars (4 votes, average: 4.25 out of 5)
Loading...

Related post

Sketchy AI

Sketchy AI

“Young man, you don’t think I’m encountering constructive symbolism for the first time, do you? “Unplug”: free yourself from physicality, from the vulgar earthbound physicality, from the evils of civilization, from electricity, nerves, and so on. Isn’t that what this is? The association is crystal clear, I’d be tempted to say, perhaps even too obvious” (Kishon 1987)

read more
AI see, AI do

AI see, AI do

You young badgers imagine that it would be enough to smear a pound of paint on the canvas and you’re already a modern painter. I would be willing to accept this abomination for a bad joke, if there was even the slightest humor behind it. But this here is an abracadabra! A nothing!

read more