References

• 📍 2025 Gen-4 - Character Consistency Across Scenes - NYC is a Zoo

HCI

• Chatbots + Speech Processing

Some parellel Attention calculation

• 📍 MEMORY - Transformers vs. RNN / LSTM

• Add Reflection - 2024 - You Only Cache Once: Decoder-Decoder Architectures for Language Models
  
  • RetNet - Retention Network -> Gated Retention
  • 2023 - RetNet: Retinal Disease Detection using Convolutional Neural Network
  • DeltaNet - 2025 - Parallelizing Linear Transformers with the Delta Rule over Sequence Length

• 2025 - Memory