Santa Fe Institute Collaboration Platform

Thermodynamics of Computation

Vijay Balasubramanian

From Thermodynamics of Computation

Biography: I am interested in how natural systems manipulate and process information, producing new forms of self-organization.

As a biophysicist I have pursued these questions primarily in neuroscience. I think about the brain as a statistical computational device and seek to uncover the principles that underlie the organization of neural circuits across scales from cells to the whole brain. I have worked on systems in the brain that support many different functions: vision, audition, olfaction, spatial cognition, motor control and decision making. Applying lessons about adaptive molecular sensing from the olfactory system, I have also written about the functional organization of the adaptive immune system in vertebrates and bacteria (CRISPR).

As a theoretical physicist, I have pursued questions about the fundamental nature of space and time. I have worked on the apparent loss of quantum information in the presence of black holes and the origin of entropy and thermodynamics in gravitating systems. I have discussed how the familiar smooth structure of space-time can emerge as a long-distance effective description of more complex underlying physical constructs. I have shown how some dimensions of space can be regarded as emergent, arising from the quantum entanglement and information structure of an underlying lower-dimensional theory.

Finally, I have written on problems in statistical inference and machine learning, and in particular on “Occam’s Razor”, i.e., the tradeoff between simplicity and accuracy in quantitative models. I am interested in this question because all scientific theories involve fitting models to data, and there is a fundamental tradeoff between the complexity of models and their ability to generalize correctly to new situations. This tradeoff influences how scientists infer models of the world, how machines learn the structure in data, and how living things from the scale of single cells to entire organisms with brains adapt to their environment over timescales from milliseconds to evolutionary time.

Field(s) of Research: General Non-equilibrium Statistical Physics, Thermodynamics of Neurobiology, Naturally Occurring Biological Computation

Related links

Reference Materials

  1. A test of metabolically efficient coding in the retina
  2. Design of a trichromatic cone array
  3. Heterogeneity and Efficiency in the Brain
  4. How Much the Eye Tells the Brain
  5. Receptive fields and functional architecture in the retina