Title :
Energy Efficient Neurons With Generalized Inverse Gaussian Conditional and Marginal Hitting Times
Author :
Jie Xing ; Berger, Toby ; Sungkar, Mustafa ; Levy, William B.
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Virginia, Charlottesville, VA, USA
Abstract :
Neuronal information processing is energetically costly. Energy supply restrictions on information processing have resulted in the evolution of brains to compute and communicate information with remarkable energy efficiency. Indeed, energy minimization subject to functional constraints is a unifying principle. Toward better comprehension of neuronal information processing and communication from an information-energy standpoint, we consider a continuous time, continuous state-space neuron model with a generalized inverse Gaussian (GIG) conditional density. This GIG model arises from a Lévy diffusion that contains both homogeneous Poisson processes and Wiener processes with drift as special cases. We show that, when the energy constraints consist of a tripartite family apropos of the GIG model, the distribution of input excitation, A, that maximizes bits per Joule (bpJ) generates an output interspike interval duration T that possesses a related GIG marginal distribution. Most importantly, we obtain the exact expression for the bpJ-maximizing distribution of A in terms of Bessel functions that are readily evaluated numerically. This permits display of the strictly concave curves of bpJ-maximized mutual information I(A; T). Because bpJ equals bits per second/watt, these curves serve as the Shannon-theory capacity v. power curves for GIG neuron models. We show that the noise in GIG channels is essentially multiplicative, so our results may have significance for broader classes of fading channels.
Keywords :
Bessel functions; Gaussian channels; energy conservation; fading channels; information theory; neural nets; stochastic processes; Bessel function; GIG channel; GIG marginal distribution; GIG neuron model; Lévy diffusion; Shannon-theory capacity; Wiener process; bits per Joule; bpJ-maximized mutual information; bpJ-maximizing distribution; concave curve; energy constraint; energy efficient neuron; energy minimization; energy supply restriction; fading channel; functional constraint; generalized inverse Gaussian conditional density; homogeneous Poisson process; interspike interval duration; marginal hitting time; neuronal information processing; power curve; tripartite family apropos; Brain modeling; Electric potential; Information processing; Ions; Mathematical model; Nerve fibers; Energy efficiency; L??vy diffusion; bits per Joule (bpJ); fast sodium channels; generalized inverse Gaussian (GIG) distribution; hitting time; information rate; inverse Gaussian (IG) distribution;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2015.2444401