Paul Devos

Delayed Memory Unit: Modelling Temporal Dependency Through Delay Gate

2023 · arXiv (Cornell University)

Recurrent Neural Networks (RNNs) are widely recognized for their proficiency in modeling temporal dependencies, making them highly prevalent in sequential data processing applications. Nevertheless, vanilla RNNs are confronted with the well-known issue of gradient vanishing …