Source Themes

On the Regularity of Attention

Note: This is a conference version of "A Mathematical Theory of Attention" arXiv:2007.02876.

Implicit Regularization via Neural Feature Alignment


A Mathematical Theory of Attention

arxiv, 2021

On the Spectral Bias of Neural Networks

ICML 2019

A Modern Take on the Bias-Variance Tradeoff in Neural Networks

arXiv, 2018

MINE: Mutual Information Neural Estimation

ICML 2018

A3T: Adversarially Augmented Adversarial Training

NIPS 2017, Machine Deception Workshop

Exploring Machine Learning for Particle Physics

Technical report, 2017

A 2-categorical state sum model

Journal of Mathematical Physics, 2015

Melonic phase transition in group field theory

Letters in Mathematical Physics, 2014