About Me

👋 Hi! I’m Zebin Huang, a PhD student at the Edinburgh Centre for Robotics. My focus areas are Robotics, Robot Learning, and Human-Machine Interaction.

🚀 Project Goal: Integrating Large Language Models with end-to-end autonomous driving models. This project is supported by 2024 Google Summer of Code and JdeRobot.

📫 Questions or suggestions? Reach out via email.

---

Project Overview

In previous editions of GSoC, we have explored Behavior Metrics as a tool for the evaluation of end-to-end autonomous driving models. We have also explored optimization of end-to-end models and navigation based on segmented images and commands (see video and project link). In this project, we would like to combine the previously acquired knowledge with Large Language Models (LLMs), using the projects that we successfully developed during past GSoC editions.

The idea is to integrate an LLM system with an end-to-end autonomous driving model so the user can give commands in text mode directly to the vehicle, as you would when using a real-life taxi (“please, stop here”, “please, turn to the left at the next intersection”). This idea has already been explored in research projects, and we will be replicating it.

Mentors: Sergio Paniego Blanco (sergiopaniegoblanco AT gmail.com), Apoorv Garg (apoorvgarg.ms AT gmail.com)， Nikhil Paliwal ( nikhil.paliwal14 AT gmail.com ), David Pérez (david.perez.saura AT upm.es) and Meiqi Zhao (skyler.zhaomeiqi AT gmail.com)

For a list of our projects, please visit repositories page.