Jiajun Fan

AI4Mat-NeurIPS-2024

Efficient Design-and-Control Automation with Reinforcement Learning and Adaptive Exploration

In brief

What the paper does.

EDiSon (Efficient Design and Stable Control) casts design optimization as a multi-step MDP and learns design and control jointly: a design policy proposes a structure step by step while a control policy operates it, both trained with deep RL against a reward that scores design quality. A design memory drives adaptive exploration — the agent regulates between building a design from scratch and replaying a stored high-quality design to refine it, which balances exploration against exploitation and stabilises control-policy learning. Because the formulation is domain-agnostic, the same method covers robot morphology design and Tetris-based design, and targets automated materials discovery.

Published in
AI4Mat-NeurIPS-2024 Workshop on AI for Accelerated Materials Design
Paper
openreview.net/forum?id=stiehhc5y6

Cite

Cite the paper.

@inproceedings{fan2024edison,
  title={Efficient Design-and-Control Automation with Reinforcement Learning and Adaptive Exploration},
  author={Fan, Jiajun and Tang, Hongyao and Przystupa, Michael and Phielipp, Mariano and Miret, Santiago and Berseth, Glen},
  booktitle={AI for Accelerated Materials Design (AI4Mat), NeurIPS 2024 Workshop},
  year={2024},
  url={https://openreview.net/forum?id=stiehhc5y6}
}