Lifestyle
The Unreasonable Syntactic Expressivity of RNNs
We prove a result that demonstrates RNNs can exactly implement bounded-depth stacks to capture a building block of human language optimally efficiently. Sit back, relax, grab some popcorn. This is a 24 minute banger. The Unreasonable Syntactic Expressivity of RNNs In 2015, Andrej Karpathy posted a now famous blog post