Tianying Ji, Yongyuan Liang, Yan Zeng, Yu Luo, Guowei Xu, Jiawei Guo, Ruijie Zheng, Furong Huang, Fuchun Sun, Huazhe Xu: ACE: Off-Policy Actor-Critic with Causality-Aware Entropy Regularization. ICML 2024: 21620-21647