Meta’s new BLT architecture replaces tokens to make LLMs more efficient and versatile

Byte Latent Transformer (BLT) uses a special architecture to learn directly from raw bytes as opposed to tokenized chunks of text.