Memory-Induced Attractor Dynamics in Liquid Time-Constant Networks
Published in 35th International Conference on Artificial Neural Networks (ICANN), 2026
While continuous-time models like Liquid Time-Constant (LTC) networks adapt flexibly to sequential data, their hidden states suffer from interference between incoming inputs and preserved long-range context. We introduce AM-LTC, an architecture that resolves this bottleneck by embedding Modern Hopfield associative memory directly into the differential state update via learned attractor dynamics. Across nine benchmark tasks, AM-LTC improves classification accuracy (from 87.18% to 89.43%) and regression MAE (from 0.251 to 0.243) over standard LTCs, while exhibiting superior robustness under increasing temporal sparsity.
