Adversarial Imitation Learning with Trajectorial Augmentation and Correction pdf link

International Conference on Robotics and Automation (ICRA) 2021

Abstract: Deep Imitation Learning requires a large number of expert demonstrations, which are not always easy to obtain, especially for complex tasks. A way to overcome this shortage of labels is through data augmentation. However, this cannot be easily applied to control tasks due to the sequential nature of the problem. In this work, we introduce a novel augmentation method which preserves the success of the augmented trajectories. To achieve this, we introduce a semi-supervised correction network that aims to correct distorted expert actions. To adequately test the abilities of the correction network, we develop an adversarial data augmented imitation architecture to train an imitation agent using synthetic experts. Additionally, we introduce a metric to measure diversity in trajectory datasets. Experiments show that our data augmentation strategy can improve accuracy and convergence time of adversarial imitation while preserving the diversity between the generated and real trajectories.

copy bibtex
@inproceedings{antotsiou2021cat,
	title={Adversarial Imitation Learning with Trajectorial Augmentation and Correction},
	author={Antotsiou, Dafni and Ciliberto, Carlo and Kim, Tae-Kyun},
	booktitle={Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA)}, 
	pages={4724--4730},
	doi={10.1109/ICRA48506.2021.9561915},
	year={2021}
	}

Demo Videos

Demo of the CAT and DAugGI networks. First, CAT is compared with random augmentation examples. Then, DAugGI trained with CAT is compared with GAIL trained with the original experts.