Zenil et al describe an algorithmic causal deconvolution method that disentangles the dimensions which originally provided meaning to the sequence solely by analysing the sequence based on algorithmic information dynamics.
https://arxiv.org/pdf/2303.16045
But how does that relate to transformers?
#AlgorithmicInformationTheory #AlgorithmicComplexity #CausalDeconvolution