New preprint “Abide by the Law and Follow the Flow: Conservation Laws for Gradient Flows” w. @SibylleMarcotte and @GabrielPeyre, we define and study “conservation laws” for the optimization of over-parameterized models. https://arxiv.org/abs/2307.00144
