Sasha Rush

Professor, Programmer in NYC.
Cornell, Hugging Face ๐Ÿค—

2022-12-22

Named Tensor Notation (TMLR version, arxiv.org/abs/2102.13196)

A rigorous description, opinionated style guide, and gentle polemic for named tensors in math notation.

* Macros: ctan.org/tex-archive/macros/la

Named Tensor Notation is an attempt to define a mathematical notation with named axes. The central conceit is that deep learning is not linear algebra. And that by using linear algebra we leave many technical details ambiguous to readers.

2022-12-21

Hi ๐Ÿ˜.

If you are looking for a winter break project, here is the full collection of ML/coding puzzles.

* github.com/srush/tensor-puzzle
* github.com/srush/gpu-puzzles
* github.com/srush/autodiff-puzz
* github.com/srush/raspy

2022-12-20

The blog post is a Python reimplementation and visualizer of the paper "Thinking Like Transformers" (arxiv.org/abs/2106.06981) .

Full version of the RASP language is here

github.com/tech-srl/RASP

2022-12-20

Blog Post: On "Thinking Like Transformers"

In which, I get a bit obsessed with learning how to code in Transformer lang๐Ÿค–.

github.com/srush/raspy

(You can follow along or do the exercises yourself in a colab notebook.)

Client Info

Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst