Tech. Note 004: Inequalities between the Jensen-Shannon and Jeffreys divergences
Jeffreys’ J-divergence and the Jensen-Shannon divergence are shown to be related by an inequality that involves a transcendental function of the Jeffreys divergence.
You May Also Enjoy
Upcoming
Amica Conference: Thermodynamic Approaches to Artificial Intelligence. March 9-11, 2026, Karuizawa, Japan.
Tech. Note: Gates, States, and Circuits
Notes on the circuit model of quantum computing. Currently mostly an exposition on the menagerie of quantum gates.
Article: Thermodynamic natural gradient descent
We show that natural gradient descent can have a similar computational complexity per iteration to a first-order method, when employing appropriate hardware.
Preprint: Solving the compute crisis with physics-based ASICs
Physics-based Application-Specific Integrated Circuits present a transformative paradigm by directly harnessing intrinsic physical dynamics for computation.