← back to blog

A Future With Neuromorphic Computing

September 19, 2024
Cortical Neurons

Biological neural systems are complex but not too complex beyond understanding. Ion concentrations such as calcium, sodium, and potassium move in and out of the cell wall of the neuron via ion channels, which in turn causes the neuron to "spike", or release an action potential down the axon and toward the terminal of the presynaptic cleft. This process triggers opening of voltage gated calcium channels, allowing calcium ions to flow inward. The influx of calcium ions causes synaptic vesicles containing neurotransmitter to bind with the presynaptic membrane, releasing the neurotransmitters into the synaptic cleft.

The neurotransmitters then cross the cleft and bind to receptor proteins of the postsynaptic neuron. As a result of the neurotransmitters binding to the membrane of the post-synaptic neuron at the membrane, ion channels in the post-synaptic then open, allowing specific ions such as Sodium (Na+) and Potassium (K+) to flow into or out of the postsynaptic neuron. From this point in this specific scenario, the movement of ions across the postsynaptic membrane causes a change in the membrane potential, which can either be excitatory or inhibitory. If the potential reaches a certain threshold, a new action potential is produced in the neuron, propagating down its axon.

If you are familiar with or currently studying machine learning and neural networks, you may have already caught on to where this is going. Current LLMs such as Recurrent Neural Networks (RNN) and obviously Classical Neural Networks (CNN) typically rely on a feed forward method, feeding data to the successive layers of artificial neurons, applying a weight, bias, and some activation function (ReLU, Leaky ReLU, Sigmoid, etc), and then analyzing the output of data or feeding it back into the model. These methods have been effective, but there is an issue with how well and accurate they mimic real biological systems.

Neuromorphic computing offers a newer approach to designing these neural networks. Unlike traditional Large Language Models (LLMs), the designs of neuromorphic systems resemble the true structure and function of the human brain, simulating biological neurons and synapses with spiking neural networks (SNNs). Neuromorphic systems also reduce power consumption by processing information in a more efficient way by spiking only when there is enough input, rather than continuously updating weights across all layers. This is no simple task however, because building a neuromorphic system means each artificial neuron should only activate and fire if a certain potential (as in membrane potential) is reached.

As of now research has been limited, but we may see an increase in interest as more viable ways to reduce power consumption are considered and engineers and researchers move away from traditional models.