An error occurred while simulating mode with the reinforcement learning agent
9 visualizaciones (últimos 30 días)
Mostrar comentarios más antiguos
I’m using reinforcement learning toolbox to train energy management controller of hybrid electric vehicle (HEV) model. I am using 5 (five) continuous state variables as input to the RL agent and 3 continuous action variables are output from the RL agent. Hence, I have used a DDPG agent since DDPG agent can handle both continuous state and action variables. My environment is comprised of vehicle plant model, reference drive speed profile, and immediate cost calculation.
For reference, I have followed the “rlwatertank” example from RL toolbox help guide since DDPG agent is also used in that example too.
Before training my agent, I made sure the whole model (agent and environment) runs without any error and warning with the command sim(‘QLearningEMSdiscreteDelay’). It ran smoothly. But, when I’m trying to train the agent through training options, MATLAB is giving the error as following:
Error using rl.train.seriesTrain (line 16)
An error occurred while simulating “QLearningEMSdiscreteDelay” the agent “agent”
Error in rl.train.TrainingManager/train (line 244)
Rl.train.seriesTrain(this);
Error in rl.train.TrainingManager/run (line 150)
train(this);
Error in rl.agent.AbstractAgent/train (line 54)
TrainingStatistics = run(trainMgr)
The only differences my model has from the “rlwatertank” example are following:
- My environment has a time-series of reference speed compared to a single value of water level in “rlwatertank” example
- There is no randomization of this reference time-series at the starting of each episode
- Time-step of my agent and environment is 0.1 seconds compared to 1 second in “rlwatertank” example
Why can't the agent start the simulation through training while it can be simulated manually?
Any help will be appreciated.
2 comentarios
Emmanouil Tzorakoleftherakis
el 25 de Oct. de 2019
Can you share the full error message? The script where you set everything up would be helpful too.
Thanks!
Hajar hammouti
el 5 de Nov. de 2019
Wondering if you have solved this error. I obtain the same error when training my qAgent and I don't know from where it comes.
Respuestas (2)
Atriya Biswas
el 5 de Nov. de 2019
Editada: Walter Roberson
el 31 de En. de 2022
1 comentario
Thoriq Fauzan
el 17 de Ag. de 2020
excuse me, does anyone already got some ideas about the cause of this? I have an almost similar problem
Ver también
Categorías
Más información sobre Training and Simulation en Help Center y File Exchange.
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!