The Amazon AWS DeepRacer Workshop aims to teach interested undergraduate students to drive the AWS DeepRacer bot on racing tracks by designing simple Reinforcement Learning (RL) models. The workshop was conducted by Dr. Rajalaxmi Rajagopalan, from the NUS ECE department. The workshop kicked off with an introductory opening from a member of the NUS IEEE Branch, followed by Dr. Rajalaxmi’s presentation on Reinforcement Learning and AWS DeepRacer’s algorithm, ending with a students’ testing of their models with a physical car. Dr. Rajalaxmi shared various examples of the variables that affect the accuracy of the model and how changing its environment impacts the result of the simulation. sFrom this workshop, students were equipped with all the information needed for them to participate in AWS Virtual DeepRacer Competition races and got a chance to win the Championship Cup competing against teams from all over the world. In the workshop, the RL models developed were tested using a DeepRacer simulator with several simulated racing tracks and also on the physical car.