Community Bonding: Week 2

Preliminaries

Through the discussion, we identify potential issues which need to be worked on before the start of the coding period. We also took a diver dive into the working of Dockers to continuously support the Behavior Metric tool. While I explore the Quick Start section, I identify interesting scripts show_pilots.py and other features to visualize the performance and save the stats of the deep learning model. Furthermore, the mentors introduced me to the development of new dataset on DeepLearningStudio [2]. After I mention an improvement in the training script, we agreed to include a validation set. In the coming weeks, we would also like to benchmark the existing models on my local machine to set a baseline for optimized models.

Objectives

• Resolve dependency issue on DeepLearningStudio’s virtual environment installation
• Fix Dockerfiles to build the workflow in Behavior Metric
• Explore the show_pilots.py script and report the relevance of it for the project
• Update the PilotNet (PyTorch) model to use new dataset in DeepLearningStudio [2]

Issues and Pull requests.

• Created issue Dependency conflict while installation #45 in DeepLearningStudio repo.
• Solved issue #45 with PR updated package versions for python3.10 #46 in DeepLearningStudio repo.
• Solved docker issues with PR Fixes failing build of Docker images (with GPU support) in the workflow #365 in BehaviorMetric repo.
• I got errors while using show_pilots.py and created corresponding issue KeyError while using show_plots.py script #366.
• Created another issue Errors using ‘scripts/analyse_brain.bash’ #367.
• I encountered additional errors while using PilotNet (Pytorch) brain, for which I created additional issues - Error while trying to save stats with DL-torch.yml config #368 and Not utilizing GPU when running simulation #369.
• Create issue Update PilotNet model to use new F1 dataset #48.
• Fixed the issue Update PilotNet model to use new F1 dataset #48 by PR Use new dataset #49.

The execution

My initial task includes upgrading Python version and related packages in the DeepLearningStudio repository and submitted PR updated package versions for python3.10 #46. Next, I worked on the issues with docker images in BehaviorMetric repository, by locally buidling, resolving errors and creating containers and then submitted PR Fixes failing build of Docker images (with GPU support) in the workflow #365. Building and fixing Dockers is especially time consuming (each build trial could takes hours). I encountered additional errors while using BehaviorMetrics for which I created corresponding issues and some solutions. The new dataset is relatively large (~ 11 GB), so extracting and managing will take time. I also updated corresponding scripts for PilotNet model in DeepLearningStudio to use new dataset.

References

[1] https://github.com/JdeRobot/BehaviorMetrics
[2] https://github.com/JdeRobot/DeepLearningStudio