Why Autodiff is down to the backend level?

[mariogeiger]

Hello,

Autodiff (AD) is a transformation that given a computational graph returns you a new computational graph (see how it is done in JAX).
Therefore I don't understand the motivation for a design that places AD at the level of the backend. It should be at the top most level where we just define the operation we want to compute.

[laggui]

Hey 👋 I see you closed your own question almost immediately, was that intentional?

[nathanielsimard]

JAX is a static graph framework, while Burn is a dynamic graph framework. Therefore, the graph is created by the operations, which is why it's a backend decorator.