Tensor network theory

The mid-20th century saw a concerted movement to quantify and provide geometric models for various fields of science, including biology and physics.[3][4][5] The geometrization of biology began in the 1950s in an effort to reduce concepts and principles of biology down into concepts of geometry similar to what was done in physics in the decades before.[3] In fact, much of the geometrization that took place in the field of biology took its cues from the geometrization of contemporary physics.[6] One major achievement in general relativity was the geometrization of gravitation.[6] This allowed the trajectories of objects to be modeled as geodesic curves (or optimal paths) in a Riemannian space manifold.[6] During the 1980s, the field of theoretical physics also witnessed an outburst of geometrization activity in parallel with the development of the Unified Field Theory, the Theory of Everything, and the similar Grand Unified Theory, all of which attempted to explain connections between known physical phenomena.[7]

The geometrization of biology in parallel with the geometrization of physics covered a multitude of fields, including populations, disease outbreaks, and evolution, and continues to be an active field of research even today.[8][9] By developing geometric models of populations and disease outbreaks, it is possible to predict the extent of the epidemic and allow public health officials and medical professionals to control disease outbreaks and better prepare for future epidemics.[8] Likewise, there is work being done to develop geometric models for the evolutionary process of species in order to study the process of evolution, the space of morphological properties, the diversity of forms and spontaneous changes and mutations.[9]

Around the same time as all of the developments in the geometrization of biology and physics, some headway was made in the geometrization of neuroscience. At the time, it became more and more necessary for brain functions to be quantified in order to study them more rigorously. Much of the progress can be attributed to the work of Pellionisz and Llinas and their associates who developed the tensor network theory in order to give researchers a means to quantify and model central nervous system activities.[1][2]

In 1980, Pellionisz and Llinas introduced their tensor network theory to describe the behavior of the cerebellum in transforming afferent sensory inputs into efferent motor outputs.[1] They proposed that intrinsic multidimensional central nervous system space could be described and modeled by an extrinsic network of tensors that together describe the behavior of the central nervous system.[1] By treating the brain as a "geometrical object" and assuming that (1) neuronal network activity is vectorial and (2) that the networks themselves are organized tensorially, brain function could be quantified and described simply as a network of tensors.[1][2]

• Sensory input = covariant tensor
• Motor output = contravariant tensor
• Cerebellar neuronal network = metric tensor that transforms the sensory input into the motor output

In 1986, Pellionisz described the geometrization of the "three-neuron vestibulo-ocular reflex arc" in a cat using tensor network theory.[10] The "three-neuron vestibulo-ocular reflex arc" is named for the three neuron circuit the arc comprises. Sensory input into the vestibular system (angular acceleration of the head) is first received by the primary vestibular neurons which subsequently synapse onto secondary vestibular neurons.[10] These secondary neurons carry out much of the signal processing and produce the efferent signal heading for the oculomotor neurons.[10] Prior to the publishing of this paper, there had been no quantitative model to describe this "classic example of a basic sensorimotor transformation in the central nervous system" which is precisely what tensor network theory had been developed to model.[10]

Here, Pellionisz described the analysis of the sensory input into the vestibular canals as the covariant vector component of tensor network theory. Likewise, the synthesized motor response (reflexive eye movement) is described as the contravariant vector component of the theory. By calculating the neuronal network transformations between the sensory input into the vestibular system and the subsequent motor response, a metric tensor representing the neuronal network was calculated.[10]

The resulting metric tensor allowed for accurate predictions of the neuronal connections between the three intrinsically orthogonal vestibular canals and the six extraocular muscles that control the movement of the eye.[10]

Neural networks modeled after the activities of the central nervous system have allowed researchers to solve problems impossible to solve by other means. Artificial neural networks are now being applied in various applications to further research in other fields. One notable non-biological application of the tensor network theory was the simulated automated landing of a damaged F-15 fighter jet on one wing using a "Transputer parallel computer neural network".[11] The fighter jet's sensors fed information into the flight computer which in turn transformed that information into commands to control the plane's wing-flaps and ailerons to achieve a stable touchdown. This was synonymous to sensory inputs from the body being transformed into motor outputs by the cerebellum. The flight computer's calculations and behavior was modeled as a metric tensor taking the covariant sensor readings and transforming it into contravariant commands to control aircraft hardware.[11]