Working on

We already know induction heads in gpt2-small via:

https://www.neelnanda.io/mosaic

So if we find an impt head that’s one of these, ask why it’s also induction.

Ongoing Issues

Done

Future Work Ideas / Postponed