Just a brief notebook showing my early attemps at reproducing https://arxiv.org/abs/2310.05918
Food for thought around the computational complexity of the calculation LMN which the authors have discussed on twitter as a short coming of this paper.
BroadbentJim/GrokkingAsCompression
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|