This paper is a melding of ideas about machine learning from Susanne Still and Tony Bell, with ideas from David and I about nonequilibrium thermodynamics. For a molecular scale machine with information processing capabilities, there’s a tradeoff between thermodynamic efficiency, memory and prediction. A prodigious memory allows more accurate prediction of the future, which can be exploited to reduce dissipation. But the persistence of memory is a liability, since information erasure leads to increased dissipation. A thermodynamically optimal machine must balance memory versus prediction by minimizing its nostalgia, the useless information about the past.
Memory has great survival utility … but why would forgetting be adaptive. Forgetting well is almost as important as remembering well. Forgetting is about editing, about taking the flood– the ocean– of sense information coming at you and forgetting everything except what’s important. Life is not only about acquiring memories. Memory can cripple us too.
Michael Pollen, The Botany of Desire
[Gavin Crooks, David Sivak]
* Improved the algorithm that guesses the sequence type (DNA, RNA or protein) (Kudos: Bug report, Roland Pache
* Fixed an issue with reading transfac matrices with alternative alphabets(Kudos: Bug report, Nima Emami
* Fixed Motif.reindex()
* Implemented Motif.reverse() and Motif.complement() (Can now reverse complement transfac matrix input on the command
line.) (Kudos: Feature request, Seth P Boudreaux
* Command line interface now automagically recognizes transfac files.
* Add command line option “–reverse-stacks NO” which inverts the logo stacks so that the most conserved monomers are at the bottom of the stack, rather than the top. This ordering is consistent with the standard ordering for histograms, and is arguably a better representation. (Kudos: Luke Hutchison
* Fixed an issue so that the correct color scheme is chosen for the specified sequence type.
* Miscellaneous minor bug fixes and refactoring.
This is mostly David’s creation, from inception to conclusion, although I like to think I’ve contributed some elegant prose. Essentially, he shows that at the intersection of linear response theory and thermodynamic length analysis, there is a really nice framework for understanding optimal protocols for driving thermodynamic systems. Continue reading
Abstract: A central endeavor of thermodynamics is the measurement of free energy changes. Regrettably, although we can measure the free energy of a system in thermodynamic equilibrium, typically all we can say about the free energy of a non-equilibrium ensemble is that it is larger than that of the same system at equilibrium. Herein, we derive a formally exact expression for the probability distribution of a driven system, which involves path ensemble averages of the work over trajectories of the time-reversed system. From this we find a simple near-equilibrium approximation for the free energy in terms of an excess mean time-reversed work, which can be experimentally measured on real systems. With analysis and computer simulation, we demonstrate the accuracy of our approximations for several simple models.
People like us, who believe in physics, know that the distinction between past, present, and future is only a stubbornly persistent illusion.
This was a fun paper that originated in a chance, serendipitous conversation between myself, Jerome and John. We realized that several different Monte Carlo sampling techniques that we had each recently worked on could be unified under a common framework by taking inspiration from nonequilibrium thermodynamics. (I am also particularly satisfied with the joke. I firmly believe every scientific paper should contain one joke, lest we take ourselves too seriously. This one is great because it’s hiding in plain sight.)
Abstract: Metropolis Monte Carlo simulation is a powerful tool for studying the equilibrium properties of matter. In complex condensed-phase systems, however, it is difficult to design Monte Carlo moves with high acceptance probabilities that also rapidly sample uncorrelated configurations. Continue reading
Gavin E. Crooks
Physics Colloquia, University College London (2011)
Here’s to the crazy ones. The misfits. The rebels. The troublemakers. The round pegs in the square holes. The ones who see things differently. They’re not fond of rules. And they have no respect for the status quo. You can quote them, disagree with them, glorify or vilify them. About the only thing you can’t do is ignore them. Because they change things. They push the human race forward. And while some may see them as the crazy ones, we see genius. Because the people who are crazy enough to think they can change the world, are the ones who do.