I want to know how to understand the sampling time ts of the agent in reinforcement learning, and how its value will affect the training and results?
1 visualización (últimos 30 días)
Mostrar comentarios más antiguos
嘻嘻
el 6 de Nov. de 2023
Comentada: Emmanouil Tzorakoleftherakis
el 9 de Nov. de 2023
I want to know how to understand the sampling time ts of the agent in reinforcement learning, and how its value will affect the training and results?
0 comentarios
Respuesta aceptada
Emmanouil Tzorakoleftherakis
el 8 de Nov. de 2023
Think of it as how often you need the agent to make decisions. Sometimes you need to make decisions very frequently (e.g. if your system dynamics are fast) and sometimes not. Could be viewed as the equivalent of a controller rate.
The smaller ts is, the more frequently the agent will make decisions, but that will make training much slower. On the other hand, if ts is large, training may progress faster, but depending on your system it may not converge.
Hope this helps
3 comentarios
Emmanouil Tzorakoleftherakis
el 9 de Nov. de 2023
You should be able to use a single agent for this application. However, since you already have a model of the system, I would first try with a model-based controller like MPC.
Más respuestas (0)
Ver también
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!