no code implementations • 24 Apr 2024 • Aobo Liang, Xingguo Jiang, Yan Sun, Xiaohou Shi, Ke Li
To enhance Mamba's ability to preserve historical information in a longer range, we design a novel Mamba+ block by adding a forget gate inside Mamba to selectively combine the new features with the historical features in a complementary manner.