Training Self Driving Cars by leveraging Raspberry pi sensors and neural networks
Autonomous cars have now gone uphill from science fiction to reality. Basic technologies behind the self-driving cars are deep learning and computer vision techniques. Self-driving cars can potentially overcome the mistakes made by human drivers thus saving human. In this project, a pr
2025-06-28 16:29:52 - Adil Khan
Training Self Driving Cars by leveraging Raspberry pi sensors and neural networks
Project Area of Specialization RoboticsProject SummaryAutonomous cars have now gone uphill from science fiction to reality. Basic technologies behind the self-driving cars are deep learning and computer vision techniques.
Self-driving cars can potentially overcome the mistakes made by human drivers thus saving human. In this project,
a prototype of self-driving is developed that has the ability to maneuver on predefined paths using convolutional neural networks and computer vision techniques.
- Development of working prototype of a self-driving using a toy car that will mainly navigate using computer vision and deep learning techniques
- Usage of Convolutional Neural Network to identify a stop sign
- Collision avoidance of self driving car
- Object detection infont of self driving car
- Recognition of speed limits on speed-limit signs by using Convolutional Neural Network
- Car sound horn and car brake lights
First Collect the data then pre-processing, the data is feed to a CNN model for training.
The training and inference is done using core i5 laptop and 1070 core i7 system.
Training data used in our project is about 70 percent of the complete data.
Supervised learning is used for training of the data.
This data is classified and labeled as Right, left and forward. This data is trained using CNN sequential model.
CNN model used for the training of the data contains 15 hidden layers. These layers include dense layer, convolutional-2D layer,
maxpooling-2D layer, flatten layer and fully connected layers. CNN is used for extracting the features from the images and learn
through these features by updating the bias and weights of the perceptron. Categorical cross entropy with Adam optimizer and a learning
rate of 0.001 is used in this model. The trained model then takes the input images from live camera and predicts which direction to choose
or stop. The trained model after prediction generates a string and through serial communication the string is sent to Arduino. Finally,
the Arduino processes the wrappers embedded in its code according to the string received from the trained model and sends control signals
to the H-bridge to drive motors of the car to move or stop according to the prediction.
- Prevention of car crashes
- Societal cost-savings
- Traffic efficiency
- Better access and mode of transportation
- Environmentally friendly
- Reduction in traffic deaths
- Drop in harmful emissions
- Lower fuel consumption
Software
Python is used in this Project as programming language
Libraries are requried for this project
- OpenCV
- Numpy
- Matplotlib
- scikit-learn
- TensorFlow
- Keras
- Pickle
Hardware
- Toy RC Car
- Rechargeable Batteries
- H-bridge Motor driver
- Arduino Mega 2560
- Pi Camera Webcam
- Training tracks
- Raspberry Pi
- Powerbank
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 79940 | |||
| Raspberry Pi | Equipment | 1 | 24800 | 24800 |
| Ardunio | Equipment | 2 | 3000 | 6000 |
| Pi Camer | Equipment | 1 | 1100 | 1100 |
| Power Bank | Equipment | 2 | 4000 | 8000 |
| Ultrasonic Sensor | Equipment | 1 | 400 | 400 |
| RC Car | Equipment | 3 | 3500 | 10500 |
| Rechargable Batteries | Equipment | 3 | 200 | 600 |
| 12 Volt charger | Equipment | 1 | 500 | 500 |
| Servo motor | Equipment | 2 | 1000 | 2000 |
| 4G Device | Equipment | 1 | 5000 | 5000 |
| Joy Stick | Equipment | 1 | 1000 | 1000 |
| Scrw Driver set | Equipment | 1 | 600 | 600 |
| soliding Iron | Equipment | 1 | 350 | 350 |
| Glue Gun | Equipment | 1 | 550 | 550 |
| soliding wire | Equipment | 1 | 250 | 250 |
| Female to male | Equipment | 1 | 150 | 150 |
| Female to Female | Equipment | 1 | 150 | 150 |
| Silicon stick | Equipment | 12 | 20 | 240 |
| Tie Cable | Equipment | 12 | 10 | 120 |
| Memory Card | Equipment | 1 | 850 | 850 |
| Cutter | Equipment | 1 | 1000 | 1000 |
| Fan for raspberrp pi | Equipment | 1 | 130 | 130 |
| Case for raspberry pi | Equipment | 1 | 250 | 250 |
| Raspberry pi charger | Equipment | 1 | 340 | 340 |
| sound sensor | Equipment | 1 | 1000 | 1000 |
| Switch Buttons | Equipment | 2 | 30 | 60 |
| Type C Cable | Equipment | 2 | 150 | 300 |
| miro HDMI | Equipment | 1 | 500 | 500 |
| Track Path | Equipment | 2 | 1000 | 2000 |
| Ardunio data cable | Equipment | 4 | 300 | 1200 |
| Stationery, Printing of Thesis | Miscellaneous | 1 | 10000 | 10000 |