Article Dans Une Revue IEEE Robotics and Automation Letters Année : 2025

Sensorimotor Learning With Stability Guarantees via Autonomous Neural Dynamic Policies

Résumé

State-of-the-art sensorimotor learning algorithms, either in the context of reinforcement learning or imitation learning, offer policies that can often produce unstable behaviors, damaging the robot and/or the environment. Moreover, it is very difficult to interpret the optimized controller and analyze its behavior and/or performance. Traditional robot learning, on the contrary, relies on dynamical system-based policies that can be analyzed for stability/safety. Such policies, however, are neither flexible nor generic and usually work only with proprioceptive sensor states. In this work, we bridge the gap between generic neural network policies and dynamical system-based policies, and we introduce Autonomous Neural Dynamic Policies (ANDPs) that: (a) are based on autonomous dynamical systems, (b) always produce asymptotically stable behaviors, and (c) are more flexible than traditional stable dynamical system-based policies. ANDPs are fully differentiable, flexible generic-policies that accept any observation input, while ensuring asymptotic stability. Through several experiments, we explore the flexibility and capacity of ANDPs in several imitation learning tasks including experiments with image observations. The results show that ANDPs combine the benefits of both neural network-based and dynamical systembased methods.
Fichier principal
Vignette du fichier
andps_journal.pdf (7.95 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04913600 , version 1 (27-01-2025)

Licence

Identifiants

Citer

Dionis Totsila, Konstantinos Chatzilygeroudis, Valerio Modugno, Denis Hadjivelichkov, Dimitrios Kanoulas. Sensorimotor Learning With Stability Guarantees via Autonomous Neural Dynamic Policies. IEEE Robotics and Automation Letters, 2025, 10 (2), pp.1760-1767. ⟨10.1109/LRA.2024.3524878⟩. ⟨hal-04913600⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More