UNIVERSITY
"Jnana Sangama", Belagavi - 590 018
A Technical Seminar work submitted in partial fulfillment of therequirement for the award of the
degree
Bachelor of Engineering
in
Information Science and Engineering
Submitted by
Rahul Raj R 1AY20IS067
Under the Guidance of
Prof. Mithuna H R
Assistant Professor
2023-2024
DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING
ACHARYA INSTITUTE OF TECHNOLOGY
(Affiliated to Visvesvaraya Technological University, Belagavi,Accredited by NAAC,Recognized by AICTE,
New Delhi)
Acharya Dr. Sarvepalli Radhakrishnan Road, Soldevanahalli, Bengaluru - 560107
2023 - 2024
Certificate
1. Prof. Dhananjaya M K
2. Prof. Yogesh N
ACKNOWLEDGEMENT
The satisfaction that accompanies the successful completion of Technical Seminar Report would
be incomplete without the mention of the people who made it possible through constant guidance and
encouragement.
I would take this opportunity to express my gratitude to Sri. B. Premnath Reddy, Founder
Chairman, Acharya Institutes, Dr. Rajath Hegde M M, Principal, and Prof. C K Marigowda, Vice
Principal, Acharya Institute of Technology for providing the necessary infrastructure to complete
this Technical Seminar Report.
I wish to express my deepest gratitude to Dr. Kala Venugopal., Associate Professor and Head of
the Department, Information Science and Engineering and also would like to thank Technical
Seminar coordinators Prof. Dhananjaya M K and Prof. Yogesh N for their constant support.
A warm thanks to the faculty of Department of Information Science and Engineering, who have
helped me with their views and encouraging ideas.
i
ABSTRACT
It is a Data science project as the data is collected in real-time. The data so collected is the eye motion of
the driver, his body posture, and facial movements. These are then fed as information into the program
that is written using python. This system already exists in multiple high-end cars and vehicles. Since the
statistics majorly reflect that most of our Indian cars do not feature this particular functionality, it gave
me the motiveto develop such a system. We often see newspaper articles where accidents occurred as
drivers feltdrowsy and hit the vehicle in front of them. This could have been avoided if their vehicle were
fitted with a technological feature called “The drowsiness Detection System” which off-late is seenin
higher-end vehicles. We have used Open Libraries such as (Open CV, Dlib, Flask,Pyhton IDLE) is a
open-source distribution of the python programming language for data science thataims to simplify
package management and deployment.
ii
Driver Drowsiness Detection 2023-2024
CHAPTER 1
INTRODUCTION
Driver drowsiness detection system is a Data Science project that helps in identifying the drowsiness
of drivers at an early stage and avoids accidents and unforeseen circumstances.
We regard this as a data science project as the data is collected in real-time. The data so collected is
the eye motion of the driver, his body posture, and facial movements. These are then fedas
information into the program that is written using python. Open libraries such as Open CV
(OpenComputer Vision), Dlib (For facial recognition), matplotlib are used to facilitate the detection.
It is a car safety technology which helps prevent accidents caused by the driver getting drowsy.
Variousstudies have suggested that around 20% of all road accidents are fatigue-related, up to 50%
on certainroads.This system already exists in multiple high-end cars and vehicles. Since the statistics
majorlyreflect that most of our Indian cars do not feature this particular functionality, it gave me the
motiveto developsuch a system.
It is a conceptual model that describes the structure and behavior of multiple components and
subsystems like multiple software applications, network devices, hardware, and even other
machinery of a system. It is Architecture Description Language (ADL) which helps to describe the
entire system architecture. So, it is a much broader topic. System architecture can be broadly
categorized into centralized and decentralized architectural an organization.
A software architecture is a set of principles that define the way software is designed and
developed. An architecture defines the structure of the software systemand how it is organized. It
also describes the relationships between components, levels of abstraction, and other aspects of the
software system. Since this project is a pilot run, We would be implementing this as a simulation
on our laptop.
This is an attempt to tell or inform the driver that he is drowsy and he needs to be alert. It raises an
alert when the facial movements detected by the webcam of the computer generate a voice message
to be alert. The continues detection of eye- lid movement is being monitored using a threshold flag
variable which is responsible for activation of the system. It is a car safety technology which helps
prevent accidents caused by the driver getting drowsy. Variousstudies have suggested that around
20% of all road accidents are fatigue-related, up to 50% on certainroads
AIT/ISE/2023-2024 Page 1
Driver Drowsiness Detection 2023-2024
This function continuously captures frames from the webcam, detects faces, and analyzes facial
landmarks to determine the driver's state. It checks for eye blinks, mouth aspect ratio, and the absence
of a driver. Depending on the state, appropriate actions are taken, such as playing sound alerts or
updating the status displayed on the screen.
Provide instant alerts and warnings when the signs of drowsiness are detectedEnable the system to
recognize signs of drowsiness at an early stageImplement a system that continuously monitors the
driver’s state .
Contribute significantly to road safety and reduce risk .Encourage drivers to prioritize adequate
rest andsleep, promoting healthier and safer driving habits.
Develop user-friendly interfaces and systems that are easy to use and understand, ensuring
widespread adoption and compliance among drivers.
Architecture Description Language (ADL) which helps to describe the entire system
architecture. So,it is a much broader topic. System architecture can be broadly categorized into
centralized and decentralized architectural an organization.
A software architecture is a set of principles that define the way software is designed and developed.
An architecture defines the structure of the software systemand how it is organized. It also describes
the relationships between components, levels of abstraction, and other aspects of the software
system. It is a car safety technology which helps prevent accidents caused by the driver getting
drowsy. Various studies have suggested that around 20% of all road accidents are fatigue-related, up
to 50% on certain roads
AIT/ISE/2023-2024 Page 2
Driver Drowsiness Detection 2023-2024
An architecture can be used to define the goals of a project, or it can be used toguide the design
and development of a new system. A software architecture is a set of principles that define the way
software is designed and developed. An architecture defines the structure of the software system
and how it is organized .This function continuously captures frames from the webcam, detects
faces, and analyzes facial landmarks to determine the driver's state. It checks for eye blinks, mouth
aspect ratio, and the absence of a driver. Depending on the state, appropriate actions are taken,
such as playing sound alerts or updating the status displayed on the screen.
• This route starts the detection process by calling the detect function.
• /: This route renders the home page, which could be an HTML template where you might
display the webcam feed and driver status.
Problem statement
Objective
• Provide instant alerts and warnings when the signs of drowsiness are detected
• Enable the system to recognize signs of drowsiness at an early stage
• Implement a system that continuously monitors the driver’s state .
• Contribute significantly to road safety and reduce risk .
• Encourage drivers to prioritize adequate rest and sleep, promoting healthier and safer
driving habits.
AIT/ISE/2023-2024 Page 3
Driver Drowsiness Detection 2023-2024
CHAPTER 2
LITERATURE SURVEY
AIT/ISE/2023-2024 Page 4
Driver Drowsiness Detection 2023-2024
AIT/ISE/2023-2024 Page 5
Driver Drowsiness Detection 2023-2024
4 Fusion of Physiological Integrating Combined EEG Enhanced
and Environmental Data physiological signals with vehicle drowsiness
for Driver Drowsiness signals with speed, road detection accuracy
Detection environmental conditions, and time by considering
factors for improved of day contextual factors
detection in addition to
physiological
5 Driver Drowsiness Addressing Ensemble learning Improved detection
.
Detection in Challenging challenges such as approach combining performance in
Conditions variable lighting multiple classifiers challenging
and driver behavior conditions through
model ensemble
techniques
AIT/ISE/2023-2024 Page 6
Driver Drowsiness Detection 2023-2024
CHAPTER
3
IMPLEMENTATION
Proposed System
Since this project is a pilot run, We would be implementing this as a simulation on our laptop.
This is an attempt to tell or inform the driver that he is drowsy and he needs to be alert. It raises
an alert when the facial movements detected by the webcam of the computer generate a voice
message to be alert. The continues detection of eye- lid movement is being monitored using a
threshold flag variable which is responsible for activation of the system.
AIT/ISE/2023-2024 Page 7
Driver Drowsiness Detection 2023-2024
Gather data from various sources such as cameras, sensors, and driver behavior monitoring
systems: Clean the collected data, remove noise, and handle missing values. For image and
video data, this might involve resizing, normalization, and augmentation. For physiological
signals, filtering and normalization techniques might be applied.
Extract relevant features from the preprocessed data. For image and video data, features
might include facial landmarks, eye closure, and head pose. For physiological signals, features
might include heart rate variability and blink rate. Feature extraction can also involve
extracting features from vehicle telemetry and environmental conditions. appropriate machine
learning or deep learning models for drowsiness detection. Common models include
Convolutional Neural Networks (CNNs) for image data, Recurrent Neural Networks (RNNs)
for time-series data like physiological signals, and hybrid models that combine different data
modalities.
Train the selected models using the labeled data.
This involves splitting the data into training and validation sets, defining appropriate
loss functions, and optimizing model parameters using techniques like gradient descent.
Evaluate the trained models using metrics such as accuracy, precision, recall, and F1-score.
This step helps assess the performance of the models and identify any issues like overfitting or
underfitting. Continuously monitor the performance of the deployed models and collect
feedback from users. Iterate on the models to improve their accuracy and robustness over time.
This might involve retraining the models with new data or fine-tuning model parameters An
architecture defines the structure of the software system and how it is organized software
architecture is a set of principles the structure of the software.
It is a car safety technology which helps prevent accidents caused by the driver getting drowsy.
Variousstudies have suggested that around 20% of all road accidents are fatigue-related, up to
50% on certainroads Continuously monitor the performance of the deployed models and
collect feedbackfrom users. Iterate on the models to improve their accuracy and robustness
over time. This might involve retraining the models with new data or fine-tuning model
parameters An architecture defines the structure of the software system and how it is
organized software architecture is a set of principles the structure of the software. This might
involve retraining the models with new data or fine-tuning model parameters An architecture
defines the structure of the software system and how it is organized software architecture is
a set of principles the structure of the software
AIT/ISE/2023-2024 Page 8
Driver Drowsiness Detection 2023-24
System Architecture
It is a conceptual model that describes the structure and behavior of multiple components and
subsystems like multiple software applications, network devices, hardware, and even other
machinery of a system. It is Architecture Description Language (ADL) which helps to describe
the entire system architecture. So, it is a much broader topic. System architecture can be broadly
categorized into centralized and decentralized architectural an organization.
A software architecture is a set of principles that define the way software is designed and
developed. An architecture defines the structure of the software systemand how it is organized. It
also describes the relationships between components, levels of abstraction, and other aspects of
the software system.
An architecture can be used to define the goals of a project, or it can be used toguide the
design and development of a new system. A software architecture is a set of principles that
define the way software is designed and developed. An architecture defines the structure of the
software system and how it is organized.
Behavioral Approach
AIT/ISE/2023-2024 Page 9
Driver Drowsiness Detection 2023-24
The architecture of a driver drowsiness detection system typically involves a combination of
hardware and software components working together to monitor and detect signs of driver fatigue
or drowsiness. Here's a high-level overview of such an architecture:
- Cameras: One or more cameras are used to capture the driver's facial features and eye movements.
- Sensors: Additional sensors like steering angle sensors, accelerometers, or EEG sensors might be
used to gather more data about the driver's behavior and physiological state.
- Image Processing: Facial detection and tracking algorithms are applied to the camera feed to
isolate the driver's face.
- Signal Processing: Data from other sensors might be filtered or processed to extract relevant
features.
- Facial Features: Features like eye closure, head pose, eye gaze direction, and blink rate are
extracted from the processed images.
- Physiological Features: Features like heart rate variability, skin conductance, or EEG patterns might
be extracted from sensor data.
- Classification: A machine learning model, often based on techniques like deep learning, SVM, or
random forests, is trained to classify extracted features into drowsy or alert states.
- Training: The model is trained using labeled data that includes instances of both drowsy and alert
states.
- Thresholding: A threshold is set for the output of the classification model. If the probability or
confidence of drowsiness exceeds this threshold, an alert is triggered.
- Integration: Output from multiple classifiers or sensors might be integrated using techniques like
fusion to improve the accuracy of drowsiness detection.
- Visual Alerts: Visual alerts can be generated on the dashboard or instrument cluster, such as
flashing lights or warning symbols.
- Auditory Alerts: Audible alerts like alarms or spoken warnings can be triggered to alert the driver.
- Haptic Alerts: Vibrations or other tactile feedback mechanisms can also be used to alert the driver.
- Driver Feedback: Systems often include mechanisms for providing feedback to the driver, such as
notifications to take a break or change driving behavior.
- Data Logging: Data about drowsiness events and driver responses may be logged for analysis
and future system improvement. This might involve retraining the models with new data or fine-
tuning model parameters An architecture defines the structure of the software system and how it
is organized software architecture is a set of principles the structure of the software.
AIT/ISE/2023-2024 Page 10
Driver Drowsiness Detection 2023-24
- Integration with Vehicle Systems: The drowsiness detection system may communicate with
other vehicle systems, such as the engine control unit (ECU), to initiate actions like reducing
speed or enabling automated driving modes in case of severe drowsiness.
- Cloud Connectivity: Some systems may have the capability to send alerts or data to a cloud
platform for further analysis or to notify fleet managers or emergency services in case of critical
events.
This architecture can vary depending on the specific implementation and the level of
sophistication of the drowsiness detection system. Additionally, advancements in technologies
like computer vision, machine learning, and sensor technology continue to influence the design
and performance of such systems. It is Architecture Description Language (ADL) which helps to
describe the entire system architecture. So, it is a much broader topic. System architecture can be
broadly categorized into centralized and decentralized architectural an organization.
A software architecture is a set of principles that define the way software is designed and
developed. An architecture defines the structure of the software systemand how it is organized. It
also describes the relationships between components, levels of abstraction, and other aspects of
the software system. This involves splitting the data into training and validation sets, defining
appropriate loss functions, and optimizing model parameters using techniques like gradient
descent.
Evaluate the trained models using metrics such as accuracy, precision, recall, and F1-score. This
step helps assess the performance of the models and identify any issues like overfitting or
underfitting. Continuously monitor the performance of the deployed models and collect feedback
from users. Iterate on the models to improve their accuracy and robustness over time.
This might involve retraining the models with new data or fine-tuning model parameters An
architecture defines the structure of the software system and how it is organized software
architecture is a set of principles the structure of the software. This might involve retraining the
models with new data or fine-tuning model parameters An architecture defines the structure of
the software system and how it is organized software architecture is a set of principles the
structure of the softwareThis might involve retraining the models with new data or fine-tuning
model parameters An architecture defines the structure of the software system and how it is
organized software architecture is a set of principles the structure of the software.
AIT/ISE/2023-2024 Page 11
Driver Drowsiness Detection 2023-24
Methodology
• Importing Required Libraries : Import necessary libraries such as Flask for web
development, OpenCV for computer vision tasks, dlib for face detection and facial
landmark recognition, numpy for numerical operations, and pygame for playing audio files.
AIT/ISE/2023-2024 Page 12
Driver Drowsiness Detection 2023-24
• Initializing Flask app : Create a Flask application instance.
• Initializing Sound Effects : Initialize sound effects using pygame for alerts such as no
driver detected, sleep detected, etc.
• Defining Utility Function : Define functions for computing distances between facial
landmarks, detecting eye blinks, calculating mouth aspect ratio, and checking for driver
fatigue.
• Main Detection Loop : This function continuously captures frames from the webcam,
detects faces, and analyzes facial landmarks to determine the driver's state. It checks for eye
blinks, mouth aspect ratio, and the absence of a driver. Depending on the state, appropriate
actions are taken, such as playing sound alerts or updating the status displayed on the
screen.
• Flask Routes:
• /open_camera: This route starts the detection process by calling the detech function.
• /: This route renders the home page, which could be an HTML template where you might
display the webcam feed and driver status.
• Running Flask App : Finally, the Flask application is run with debugging enabled.
• Detecting driver drowsiness using data science involves several steps and methodologies.
Here's a general outline:
• Data Collection : Gather data from various sources such as cameras, sensors, and driver
behavior monitoring systems. This data can include images, videos, physiological signals
(like heart rate and eye movement), vehicle telemetry (speed, acceleration),
andenvironmental conditions (time of day, weather).
• Clean the collected data, remove noise, and handle missing values. For image and video
data, this might involve resizing, normalization, and augmentation. For physiological
signals, filtering and normalization techniques might be applied.
• Extract relevant features from the preprocessed data. For image and video data, features
might include facial landmarks, eye closure, and head pose. For physiological signals,
features might include heart rate variability and blink rate. Feature extraction can also
involve extracting features from vehicle telemetry and environmental conditions.
• Choose appropriate machine learning or deep learning models for drowsiness detection.
Common models include Convolutional Neural Networks for image data, Recurrent Neural
Networks for time-series data like physiological signals, and hybrid models that combine
different data modalities.
AIT/ISE/2023-2024 Page 13
Driver Drowsiness Detection 2023-24
• Train the selected models using the labeled data. This involves splitting the data into
training and validation sets, defining appropriate loss functions, and optimizing model
parameters using techniques like gradient descent.
• Evaluate the trained models using metrics such as accuracy, precision, recall, and F1-score.
This step helps assess the performance of the models and identify any issues like overfitting
or underfitting.
• Deploy the trained models into real-world systems, such as in-vehicle monitoring systems or
smartphone apps. Ensure that the deployment environment is compatible with the
computational requirements of the models and that the models can process incoming data in
real-time.
• Monitoring and Iteration Continuously monitor the performance of the deployed models and
collect feedback from users. Iterate on the models to improve their accuracy and robustness
over time. This might involve retraining the models with new data or fine-tuning model
parameters.
• Throughout this process, it's essential to consider ethical and privacy implications, such as
ensuring that the collected data is anonymized and obtaining consent from users for data
collection and processing. Additionally, robust testing and validation procedures are crucial
to ensure the reliability and safety of the drowsiness detec tion system in real-world
scenarios.
AIT/ISE/2023-2024 Page 14
Driver Drowsiness Detection 2023-24
CHAPTER 4
RESULTS
Numerous examples with shifting exactnesses were assembled and consequently a table plotted for
them Every individual who volunteered for the test will be approached to squint multiple times and
act languid multiple times amid the test procedure. The eye squinting exactness was determined by
beneath referenced recipe
Every individual who volunteered for the test will be approached to squint multiple times and act
languid multiple times amid the test procedure.
The eye squinting exactness was determined by beneath referenced recipe Eye Detection
Accuracy = total number of times eyes detected / (total no. of eyes detected+ total no of times eyes
not detected)
Drowsiness Detection Accuracy = total no. of times alarm sounds / (total no. of times alarm
sounds + total no of times alarm didn’t sound) Face or eyes sometimes might not be detected due
to lack of ample ambient light. It will in general be seen from the above table that in case model 3
isn't mulled over, at that point the framework has an accuracy of about 100%. That said; the high
proportion of disappointments in test 3 exhibits that the framework is slanted to botch and has
certain obstacles. In test 3 we didn't utilize ample backdrop lights for the webcam. The subsequent
poor lighting conditions gave a very error prone result.
AIT/ISE/2023-2024 Page 15
Driver Drowsiness Detection 2023-24
AIT/ISE/2023-2024 Page 16
Driver Drowsiness Detection 2023-24
AIT/ISE/2023-2024 Page 17
Driver Drowsiness Detection 2023-24
CHAPTER 5
CONCLUSION
Driver drowsiness detection systems play a pivotal role in enhancing road safety by mitigating the
risks associated with driver fatigue. Through the integration of advanced technologies such as
machine learning algorithms, computer vision, and sensor fusion, these systems can accurately
identify signs of drowsiness in drivers and issue timely alerts to prevent accidents.
Furthermore, the widespread adoption of driver drowsiness detection technology has the
potential to save countless lives and prevent injuries by addressing one of the leading causes of
road accidents worldwide. By raising awareness about the dangers of driving while drowsy and
providing real-time alerts to drivers, these systems serve as an invaluable tool in promoting
responsible driving behavior and reducing the incidence of fatigue-related crashes.
Moreover, as automotive manufacturers and technology developers continue to refine and
enhance these systems, future iterations may incorporate additional features such as personalized
alerts, adaptive responses based on individual driving patterns, and integration with autonomous
driving technologies. Such advancements hold promise for even greater effectiveness in
preventing accidents and ensuring road safety for drivers, passengers, and pedestrians alike. In
conclusion, the development and implementation of driver drowsiness detection systems represent
a significant step towards reducing road accidents caused by driver fatigue. However, continual
research and innovation are necessary to improve the accuracy, reliability, and effectiveness of
these systems, ultimately contributing to safer roads for all.
AIT/ISE/2023-2024 Page 18
DeepFakeDetectionForHumanFaceImagesand Videos
REFERENCES
[1] https://pyimagesearch.com/2017/05/08/drowsiness-detection-opencv/
[2] https://www.pantechsolutions.net/driver-drowsiness-detection-using-opencv-and-python
[3] https://data-flair.training/blogs/python-project-driver-drowsiness-detection-system/
[4] https://en.wikipedia.org/wiki/Driver_drowsiness_detection
[5] Real-Time Driver Drowsiness Detection System Using Deep Learning Technique by
Abdullah Almehmadi, et al. (2019).
[6] Driver Drowsiness Detection Based on Physiological Signals: A Review by Zhiwei Luo, et al.
(2019).
[7] A Review of Driver Drowsiness Detection Systems: 2019 by Abdulrafih Mustapha, et al.
(2019).
[8] Driver Drowsiness Detection System Based on Image Processing and Machine Learning
Techniques by Yasin Uludag, et al. (2020).
[9] A Review on Vision-Based Drowsiness Detection Systems for Driver Safety by Pradeep
Kumar, et al. (2021).
AIT/ISE/2023-2024 1
9
Driver Drowsiness Detection 2023-2024
AIT/ISE/2023-2024 Page
20
Driver Drowsiness Detection 2023-24
AIT/ISE/2023-2024 Page 21
Driver Drowsiness Detection 2023-24
AIT/ISE/2023-2024 Page 22