D Rasp Preprint

We propose a way to rewrite trained models into D-RASP – a programming language that mimics transformers, and show that it works, at least in the controlled setting of small models and algorithmic and formal languages tasks. See the paper on arxiv and this blog post for more visualizations and examples of decompiled programs.

UPD: accepted to ICML 2026!