Many modern machine learning problems can be cast as bilevel optimization problems: few-shot learning, causality, model selection, dataset distillation, adversarial attacks etc. More generally, ...
This paper demonstrates applications of automatic differentiation with nested dual numbers in the diffusion operator integral variance-reduction framework originally proposed by Heath and Platen.