Real-time Fatigue Detection for Driver Monitoring Systems

Real-time Fatigue Detection for Driver Monitoring Systems

Fatigue is a major factor causing road fatalities. With the aim of enhancing Driver Monitoring Systems with fatigue detection module, our R&D engineers have developed a custom computer vision algorithm that assesses the driver’s drowsiness based on a number of factors. Read more to discover how we quantified fatigue to alert the driver when they are at the risk of driving tired.

Why Enhanced Safety is Critical to Automotive Industry

As self-driving technologies are transforming the automotive industry, enhanced safety features become crucial for car manufacturers to stay competitive. This is due to the fact that Transportation along with Construction, Manufacturing, and Utilities is a safety-critical industry in which the consequences of failure or malfunction are usually injury and lasting damage or even loss of life. These industries are at higher risk for fatigue-related incidents and injuries than industries overall.

Driver Monitoring Systems play a pivotal role in reducing incidents in safety-critical industries, especially in the automotive industry. Today’s post will cover how our Computer Vision engineers approached the fatigue detection task to manage the risk of drowsy driving.

Managing Driver Tiredness with Fatigue Detection

Fatigue Symptoms

Abto fatigue detection algorithm is a camera-based computer vision technology that assesses driver alertness by monitoring the set of symptoms shown in the table below.

Fatigue SymptomIts Measurable Indicator
SleepingShut eyes duration
Frequent eyelid closureClosed eyes ratio
Excessive blinkingBlinking frequency
Head tiltingHead tilt ratio
YawningYawning ratio

The next video illustrates the work of our custom fatigue detection algorithm. Turn on subtitles to see real-time explanations of how each of the five described symptoms is detected.

Fatigue detection: legend

See the legend to understand visualization used in the video:

  1. Number of fatigue symptom and the way it is detected
  2. Detected face (green bounding box)
  3. Eye aspect ratio (EAR)
  4. Eye regions (green contour)
  5. Head orientation vector
  6. Detected eyes (purple bounding boxes)
  7. Mouth region (yellow contour)
  8. Face detection accuracy
  9. Head tilt angle (absolute angle)
  1. Closed eyes duration
  2. Closed eyes ratio
  3. Blinking frequency
  4. Percentage of eye closure (PERCLOS)
  5. Head tilt ratio
  6. Tangent of head tilt angle
  7. Yawn ratio
  8. Mouth aspect ratio (MAR)
  9. EAR graph
  10. Inverted eye aspect ratio (EAR) graph for EAR<0.3
  11. Mouth aspect ratio (MAR) graph
  12. Head tilt angle graph

Tools & Technologies used for Driver Fatigue Detection

  • OpenCV
  • Python
  • dlib
  • Deep neural networks (DNNs)
  • Facial mapping and facial landmark detection
  • Haar cascades
Summary
Camera-based Fatigue Detection for Driver Monitoring Systems
Title
Camera-based Fatigue Detection for Driver Monitoring Systems
Description

How our computer vision engineers approached the fatigue detection task to measure and quantify fatigue to manage the risk of driving tired.

Contact us

Tell your idea, request a quote or ask us a question