On the Identification of Temporally Causal Representation with Instantaneous Dependence

no code implementations • 24 May 2024 • Zijian Li, Yifan Shen, Kaitao Zheng, Ruichu Cai, Xiangchen Song, Mingming Gong, Zhifeng Hao, Zhengmao Zhu, Guangyi Chen, Kun Zhang

To fill this gap, we propose an \textbf{ID}entification framework for instantane\textbf{O}us \textbf{L}atent dynamics (\textbf{IDOL}) by imposing a sparse influence constraint that the latent causal processes have sparse time-delayed and instantaneous relations.

Beware of Instantaneous Dependence in Reinforcement Learning

no code implementations • 9 Mar 2023 • Zhengmao Zhu, YuRen Liu, Honglong Tian, Yang Yu, Kun Zhang

Playing an important role in Model-Based Reinforcement Learning (MBRL), environment models aim to predict future states based on the past.

Model-based Reinforcement Learning reinforcement-learning +1