From TensorFlow and PyTorch to Jax and Julia: Engineering Trade-Offs in Automatic Differentiation
In order to understand the differences between automatic differentiation libraries, let’s talk about the trade-offs that were made by the people who made them. I would say that none of these libraries are better than the other. They all make engineering decisions based on the domains and use cases