TPTT Documentation

TPTT is a modular Python library designed to inject efficient linearized attention (LiZA) mechanisms—such as Memory as Gate (described in Titans)—into pretrained transformers 🤗.

Contents:

• tptt package
  • Submodules
  • tptt.configuration_tptt module
  • tptt.modeling_tptt module
  • tptt.train_tptt module
  • Module contents