Network inference in stochastic systems from neurons to currencies: Improved performance at small sample size.

Phys Rev E 2019 Feb;99(2-1):023311

School of Computational Sciences, Korea Institute for Advanced Study, Seoul 02455, Korea.

The fundamental problem in modeling complex phenomena such as human perception using probabilistic methods is that of deducing a stochastic model of interactions between the constituents of a system from observed configurations. Even in this era of big data, the complexity of the systems being modeled implies that inference methods must be effective in the difficult regimes of small sample sizes and large coupling variability. Thus, model inference by means of minimization of a cost function requires additional assumptions such as sparsity of interactions to avoid overfitting. In this paper, we completely divorce iterative model updates from the value of a cost function quantifying goodness of fit. This separation enables the use of goodness of fit as a natural rationale for terminating model updates, thereby avoiding overfitting. We do this within the mathematical formalism of statistical physics by defining a formal free energy of observations from a partition function with an energy function chosen precisely to enable an iterative model update. Minimizing this free energy, we demonstrate coupling strength inference in nonequilibrium kinetic Ising models, and show that our method outperforms other existing methods in the regimes of interest. Our method has no tunable learning rate, scales to large system sizes, and has a systematic expansion to obtain higher-order interactions. As applications, we infer a functional connectivity network in the salamander retina and a currency exchange rate network from time-series data of neuronal spiking and currency exchange rates, respectively. Accurate small sample size inference is critical for devising a profitable currency hedging strategy.

Download full-text PDF

Source
http://dx.doi.org/10.1103/PhysRevE.99.023311DOI Listing

Still can't find the full text of the article?

We can help you send a request to the authors directly.
February 2019
1 Read

Publication Analysis

Top Keywords

small sample
12
model updates
8
iterative model
8
sample size
8
free energy
8
currency exchange
8
cost function
8
goodness fit
8
model
5
observations partition
4
partition function
4
function energy
4
coupling strength
4
energy observations
4
demonstrate coupling
4
defining formal
4
formal free
4
strength inference
4
physics defining
4
energy function
4

References

(Supplied by CrossRef)

Similar Publications