Training Quadrotor using PPO agent

8 visualizaciones (últimos 30 días)
Mahmoud Chick Zaouali
Mahmoud Chick Zaouali el 27 de Abr. de 2022
So I am trying to control a quadrotor model using Reinforcement learning. My agent will control my quadrotor and make it navigating to a desired position or following a path. Right now I am trying to train my PPO agent to hover the quadrotor. I built a dynamical model of the quadrotor with 6DOF block. After that I built the observation and reward function of my agent.
I coded the actor critic network and set my parameters.The problem is my reward function is always equals to 0 and my agent is not learning and I am suspuscious that I didn't build the environment correctly. I have been working on my model for long period and couldn't make my agent learn a little. I will really be glad if someone can support me on this issue.
I attached my quadrotor Reinforcement learning model with actor and critic codes.

Respuestas (1)

Emmanouil Tzorakoleftherakis
Emmanouil Tzorakoleftherakis el 28 de Abr. de 2022
Editada: Emmanouil Tzorakoleftherakis el 28 de Abr. de 2022
Hello,
There are multiple things not set up properly, including:
1) The isdone flag seems to be 1 all the time leading to episodes terminating early, after a single step
2) The reward signal is often not a scalar real number. One reason is that you are trying to calculate the sq root of a negative number
3) Your Simulink model has a lot of algebraic loops - I would get rid of those to make sure they don't interfere with training.
Hope that helps
  1 comentario
Unmanned Aerial and Space Systems
Unmanned Aerial and Space Systems el 2 de Mayo de 2022
Hi, like this problem, I shared my model:
https://www.mathworks.com/matlabcentral/answers/1708930-reinforcement-learning-based-quadrotor-control-using-soft-actor-critic-the-reward-is-not-converging?s_tid=prof_contriblnk

Iniciar sesión para comentar.

Productos


Versión

R2021a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by