A Survey “Fatigue Monitoring System”

 

 

This is a fatigue detection system implemented in smartphone. This system will detect the drowsiness of the driver while he is driving. And if the reverie is detected by the system then it will generate an alert. In this the parameters are blinking of eyes, mouth yawning and head shaking. Head shaking is the new parameter which is used in this system. These parameters are calculated to identify driver’s weariness. The Canny Active Contour method is used for detecting yawning and the Harr-like technique is used for detecting face and eye blinking.

1. INTRODUCTION

Now a days because of the reverie and fatigue of the drivers daily the huge amount of accidents are occurs which becomes the reason of deaths, injuries, etc. For preventing accidents it is essential to monitor the fatigue and vigilance level.

With the help of various active safety systems we can monitor the fatigue of driver, drowsiness of the driver, traffic on the roads, the vehicle and the F providing alerts to the driver. Using a statistically anthropometric face model the important facial points are automatically detected [2007]. Many researchers have focused on drivers behavioral measures using various techniques such as visual based detection and Physiological detection.

For face detection the Adaboost algorithm is used [2016]. Optic nurve fatigue correspondingly causes the eye blinking when the driver goes in state of reverie.

Fatigue and distraction detection can be observed by head orientation and head shaking is used only for fatigue detection.

Table1: Summary of the face detection techniques

Algorithm OrTechnique	Description
Neural network based face detection	Neural network based system examines small windows of an image and choses whether each window contains a face.
Hidden Markov Models Method	It deals with images which have variation in facial expression as well as orientation and also different lightning.
Fisherface Method	It considers the ratio between the variation of one person and that of another person.
Eigenface Method	It works with differences between face images, rather than with single face images.
Adaboost boosting algorithm	It improves the classification accuracy. It works with two inputs training dataset and set of features (classification function) .
Haar-like technique	It focuses on only image intensities such as the RGB pixel values of each and every pixel of image.
Feature Base Face Detection	It is more accurate and it uses low execution time.
Geometric Base Face Detection	It is effective approach and easy to implement.

To detect the face the Gravity Center Template method is used. Also for detecting the mouth corner Gray Protection and Gabor Wavelets technique is used. LDA technique is used for yawning. For detecting the lips motion features Spatial Fuzzy C-means clustering (s-FCM) method is used.

Also for the face detection skin color & texture are used. For identifying color shape we can use the color values like RGB, YCbCR and HSV and so on. Tracking algorithm is used to Face detection. Based on face detection Kalman Filter Motion Tracking algorithm is used.

2. RELATED WORK :

1. A DROWSINESS AND POINT OF ATTENTION MONITORING SYSTEM FOR DRIVER VIGILANCE

Jorge Batista [1] proposed a system which represents a framework which combines a robust feature location of face with face modeling having elliptical shape to measure the drowsiness and fatigue of driver in 2007. The solution works with the two parameters that are computation of eyelid movements and attention of head point.

By using statistically anthropometric face model it detect the facial points automatically. It is one of the advantage in this paper. The measures the features of human face, it is calculated by anthropometry models and it deals with the biological area.

But the disadvantage of this system is that the parameters used for detecting the vigilance level of driver are not sufficient, the parameters such as yawning should be considered for detecting the drowsiness.

2. DRIVER DROWSINESS MONITORING BASED ON YAWNING DETECTION

Shabnam Abtahi, Behnoosh Hariri, Shervin Shirmohammadi [2] proposed a system for monitoring and detecting driver’s drowsiness in 2011. For identifying drivers fatigue and drowsiness it can detect the various techniques like yawning, eye tiredness, eye movement, face tracking and drowsiness monitoring. The use of existing systems that monitor a vigilance level of drivers is important to prevent road accidents. Some of the main warning signs that can be measured or identified as indications of driver fatigue are : daydreaming while on the road driving over the center line, yawning , feeling impatient, feeling reacting slowly, heavy eyes, sleepy face, blinking of eyes and motion of lips.

For the purpose of the detection of the face region using the difference among two images. Drivers yawn is then tracked on the bases of the distance between the midpoint of nostrils and the chin uses Gravity-Center template to track the face. Detection of mouth corners we can use grey projection and Gabor wavelets.

Finally to detect yawning LDA is applied to classify feature vectors. Then, through spatial fuzzy c-means (s-FCM) clustering a mouth window is extracted from the face region, in which lips are tracked.

The advantage of the existing system is that yawning detection system is newly included which is not present in previous system. Also it recognizes face by using the face color and texture. The color shape can be recognize by RGB, YCbCR and HSV [2].

3. A METHOD OF DETECTING DRIVER DROWSINESS STATE BASED ON MULTI-FEATURES OF FACE

Ping Wang and Lin Shen [3] proposed a system to detect face region because of its high correct rate the AdaBoost algorithm is used in 2012. So then the final solution found is that the exact positions of driver’s eyes and mouth are placed depending upon their geometric features respectively.

Not only the technique of PATECP (Percentage And Time that Eyelids Cover the Pupils) and PATMIO (Percentage And Time that Mouth Is Open)  but also the new judging rules and techniques are used to find out whether the driver is drowsy or not.

The actual tests with current driving videos represents that our technique of detecting drivers drowsiness is based on eye as well as mouth features makes the conditions of detecting the driver’s reverie state wider and most accurate.

Finally, in short in the format of summary this existing paper represents the working of facial reverie state, state tracking, formatting, region location and AdaBoost algorithm are used.

The advantage of this system is that it is well and high accurate system and without influence from light.

4. AN EFFICIENT SYSTEM TO IDENTIFY USER ATTENTIVENESS BASED ON FATIGUE DETECTION

Syed Imran Ali, Dr. Prashant Singh, Sameer Jain [4] proposed a user alertness identification system which is based on fatique detection in 2014. In this system the web camera continuously captures images of the subject. By using efficient image processing techniques it focuses on lips and eyes to monitor their behavior.

It firstly captures the image that is input RGB image and convert it into gray image. By using erosion and dilation techniques the gray image is converted into blur image. The Sobel edge detection filter algorithm is used to find the edges of blur image. After detecting the face, this image is cut into two halves eyes part and mouth part. Again the first halve i.e. eye part image is cut into two parts left eye part and right eye part. If the drowsiness is detected in these images then it generates alert.

The advantages of this system are that it works efficiently with even in the presence of different illumination sources

background , also it is light weight and it requires less CPU execution time.

Fig 1. Flowchart of the system

5. FEER – Driver’s vigilance monitoring

Ismail Shaykha, Ahmad Menkara, Michel Nahas, Milad Ghantous [5] propsed a Non-Intrusive Facial Expression and Emotional Recognition for Driver’s vigilance monitoring. In this system, using an integrated camera with on-board processor face features such as eyes and mouth are detected and quickly analyzed.

Firstly the facial detection is done using Adaboost boosting algorithm. After that the various features are extracted. The eye analysis and mouth analysis is done. The analysis is done and based on that analysis the decision is taken.

The main advantage of this system is that it is able to distinguish between normal eye blinking and beginning of sleepiness and complete sleep. The disadvantage of this system is that it requires an integrated camera.

6. A SMARTPHONE-BASED DRIVER FATIGUE DETECTION USING FUSION OF MULTIPLE REAL-TIME FACIAL FEATURES

Yantao Qiao, Kai Zeng, Lina Xu and Xiaoyu Yin [6] proposed a fatigue monitoring system which focuses on fusion of information, it is implemented and designed in smartphone. The driver’s fatigueness indicators are eye blinking, head nodding and yawning are detected. The face and eye blinks are detected by using Harr-like technique. And the mouth yawning is detected by using Canny Active Contour method.

In this system the new parameter is added for detecting the fatigue is head nodding i.e. head shaking.

The main advantage of this system is that it uses smart phone for detecting the fatigue of driver for preventing him from accidents and does not require other equipments such as camera.

3. COMPARISON :

All the methods that are used for detection of drowsiness has different approaches. The methods differ from each other such that different methods uses different algorithms, tools and techniques for detection of drowsiness. The various algorithm used for the detection of drowsiness are shown Table1: Summary of the face detection techniques.

Harr-like technique is used for the face and eye blinks detection. And for the mouth yawning detection Canny Active Contour method is used. By using this techniques the various facial features can captured to detect the reverie of driver. The main advantage of this system is that it does not require other equipment’s such as camera.

So by surveying all these systems we can conclude that the “A SMARTPHONE-BASED DRIVER FATIGUE

DETECTION USING FUSION OF MULTIPLE REAL” approach can be considered as advantageous.

CONCLUSION :

In this way we have surveyed few techniques which are used for driver fatigue detection. Some of the technique or algorithm uses single facial feature to detect the fatigue of driver and prevent from accidents. From above mentioned approaches the last approach is having addition features to detect fatigue of driver. We can use the various facial features to detect driver’s drowsiness such as eye detection, face detection, yawning, head shaking. This approach is more advantageous in sense that it uses a new concept that is head shaking for the detection of driver fatigue because of these it will easily found the drowsiness of a driver. This system is based on smart phone so there is no need of other equipment’s.

REFERENCES

1] Jorge Batista, “A Drowsiness and Point of Attention Monitoring System for Driver Vigilance” in Proceedings of the IEEE Intelligent Transportation Systems Conference Seattle, WA, USA, Sept. 30 – Oct. 3, 2007.

2] Shabnam Abtahi, Behnoosh Hariri, Shervin Shirnohammadi , “Driver Drowsinss Monitoring Based on Yawning Detection” in Distributed Collaborative Virtual Environment Reasarch Laboratory University Of Ottawa, Canada- 2011.

3] Ping Wang, Lin Shen, “A Method of Detecting Driver Drowsiness State Based on Multi-features of Face” in Proceedings of the 5th International Congress on Image and Signal Processing (CISP 2012) – 2012.

4] Syed Imran Ali, Dr.Prashant Singh,  Sameer Jain, “An Efficient System to Identify User Attentiveness Based on Fatigue Detection” – 2014.

5] Ismail Shaykha, Ahmad Menkara, Michel Nahas, Milad Ghantous, “FEER: Non-Intrusive Facial Expression and Emotional Recognition For Driver’s Vigilance Monitoring”  in Proceedings 57th International Symposium ELMAR-2015, 28-30 September 2015, Zadar, Croatia.

6] Yantao Qiao, Kai Zeng, Lina Xu, Xiaoyu Yin, “A Smartphone-Based Driver Fatigue Detection Using Fusion of Multiple Real-Time Facial Features” in Proceedings 13th IEEE Annual Consumer Communications & Networking Conference (CCNC) – 2016