Gestão & Produção
Gestão & Produção

Automated risk assessment for material movement in manufacturing

Ninad Pradhan; Prashanth Balasubramanian; Rupy Sawhney; Mohammad Hashir Khan

Downloads: 0
Views: 19


Abstract: Proximity movements between vehicles transporting materials in manufacturing plants, or “interfaces”, result in occupational injuries and fatalities. Risk assessment for interfaces is currently limited to techniques such as safety audits, originally designed for static environments. A data-driven alternative for dynamic environments is desirable to quantify interface risks and to enable the development of effective countermeasures. We present a method to estimate the Risk Prioritization Number (RPN) for mobile vehicle interfaces in manufacturing environments, based on the Probability-Severity-Detectability (PSD) formulation. The highlight of the method is the estimation of the probability of occurrence (P) of vehicle interfaces using machine learning and computer vision techniques. A PCA-based sparse feature vector for machine learning characterizes vehicle geometry from a top-down perspective. Supervised classification on sparse feature vectors using Support Vector Machines (SVMs) is employed to detect vehicles. Computer vision techniques are used for position tracking to identify interfaces and to calculate their probability of occurrence (P). This leads to an automated calculation of RPN based on the PSD formulation. Experimental data is collected in the laboratory using a sample work area layout and scale versions of vehicles. Vehicle interfaces and movements were physically simulated to train and test the machine learning model. The performance of the automated system is compared with human annotation to validate the approach.


Risk assessment, FMEA, Machine learning, Work safety


Aoude G. S., How J. P. Using support vector machines and Bayesian filtering for classifying agent intentions at road intersections. 2009.

Barral V., Suárez-Casal P., Escudero C. J., García-Naya J. A. Multi-sensor accurate forklift location and tracking simulation in industrial indoor environments. Electronics (Basel). 2019;8(10):1152.

Behrje U., Himstedt M., Maehle E. An autonomous forklift with 3d time-of-flight camera-based localization and navigation.. 2018:1739-46.

Birchfield S. Image processing and analysis.. 2016.

Bostelman R. Towards improved forklift safety: white paper.. 2009:297-302.

Brilakis I., Park M.-W., Jog G. Automated vision tracking of project related vehicles. Advanced Engineering Informatics. 2011;25(4):713-24.

Occupational outlook handbook.. 2007.

Occupational outlook handbook.. 2011.

Employer-reported workplace injuries and illnesses.. 2014.

Disabling work injuries involving forklifts. California work injuries and illnesses. 1982.

Cao L., Depner T., Borstell H., Richter K. Discussions on sensor-based Assistance Systems for Forklifts.. 2019:1-8.

Chernousov V. O., Savchenko A. V. A fast mathematical morphological algorithm of video-based moving forklift truck detection in noisy environment.. 2014.

Collins J. W., Smith G. S., Baker S. P., Warner M. Injuries related to forklifts and other powered industrial vehicles in automobile manufacturing. American Journal of Industrial Medicine. 1999;36(5):513-21.

Collins J. W., Smith G. S., Baker S. P., Landsittel D. P., Warner M. A case‐control study of forklift and other powered industrial vehicle incidents. American Journal of Industrial Medicine. 1999;36(5):522-31.

Cortes C., Vapnik V. Support-vector networks. Machine Learning. 1995;20(3):273-97.

De Vries J., de Koster R., Stam D. Safety does not happen by accident: antecedents to a safer warehouse. Production and Operations Management. 2016;25(8):1377-90.

Unit E1 – The Social Situation in the European Union 2008 - New Insights into Social Inclusion. 2009.

Friedman J., Hastie T., Tibshirani R. The elements of statistical learning. 2001;1.

Gandhi T., Trivedi M. M. Pedestrian collision avoidance systems: a survey of computer vision based recent studies. 2006:976-81.

Groza B., Briceag C. A vehicle collision-warning system based on multipeer connectivity and off-the-shelf smart-devices.. 2017:115-23.

Hämäläinen P., Saarela K. L., Takala J. Global trend according to estimated number of occupational accidents and fatal work-related diseases at region and country level. Journal of Safety Research. 2009;40(2):125-39.

Hanoun S., Bhatti A., Creighton D., Nahavandi S., Crothers P., Esparza C. Target coverage in camera networks for manufacturing workplaces. Journal of Intelligent Manufacturing. 2016;27(6):1221-35.

Jo B. W., Lee Y. S., Khan R. M. A., Kim J. H., Kim D. K. Robust Construction Safety System (RCSS) for collision accidents prevention on construction sites. Sensors (Basel). 2019;19(4):932.

Kim K., Davis L. S. Multi-camera tracking and segmentation of occluded people on ground plane using search-guided particle filtering.. 2006:98-109.

Kusiak A. Smart manufacturing. International Journal of Production Research. 2018;56(1-2):508-17.

Lai Y. K., Ho C. Y., Huang Y. H., Huang C. W., Kuo Y. X., Chung Y. C. Intelligent vehicle collision-avoidance system with deep learning.. 2018:123-6.

Lang A. Evaluation of an intelligent collision warning system for forklift truck drivers in industry. 2018:610-22.

Lang A., Günthner W. A. Evaluation of the usage of support vector machines for people detection for a collision warning system on a forklift.. 2017:322.

Li X., Wang K., Wang W., Li Y. A multiple object tracking method using Kalman filter.. 2010:1862-6.

Liu H.-C., Liu L., Liu N. Risk evaluation approaches in failure mode and effects analysis: a literature review. Expert Systems with Applications. 2013;40(2):828-38.

Lucas B. D., Kanade T. An iterative image registration technique with an application to stereo vision. International Joint Conference on Artificial Intelligence (IJCAI). 1981;81(1):674-9.

Marhavilas P. K., Koulouriotis D., Gemeni V. Risk analysis and assessment methodologies in the work sites: on a review, classification and comparative study of the scientific literature of the period 2000–2009. Journal of Loss Prevention in the Process Industries. 2011;24(5):477-523.

Marsh S. M., Fosbroke D. E. Trends of occupational fatalities involving machines, United States, 1992–2010. American Journal of Industrial Medicine. 2015;58(11):1160-73.

Memarzadeh M., Golparvar-Fard M., Niebles J. C. Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors. Automation in Construction. 2013;32:24-37.

Messelodi S., Modena C. M., Zanin M. A computer vision system for the detection and classification of vehicles at urban road intersections. Pattern Analysis & Applications. 2005;8(1):17-31.

Mosberger R., Leibe B., Andreasson H., Lilienthal A. Multi-band hough forests for detecting humans with reflective safety clothing from mobile machinery.. 2015.

Papageorgiou C., Poggio T. A trainable system for object detection. International Journal of Computer Vision. 2000;38(1):15-33.

Perttula P., Salminen S. Workplace accidents in materials transfer in Finland. International Journal of Occupational Safety and Ergonomics. 2012;18(4):541-8.

Pradalier C., Tews A., Roberts J. Vision-based operations of a large industrial vehicle: autonomous hot metal carrier. Journal of Field Robotics. 2008;25(4-5):243-67.

Pratt S. G., Kisner S. M., Helmkamp J. C. Machinery-related occupational fatalities in the United States, 1980 to 1989. Journal of Occupational and Environmental Medicine. 1996;38(1):70-6.

Quan N. V., Eum H. M., Lee J., Hyun C. H. Vision sensor-based driving algorithm for indoor automatic guided vehicles. International Journal of Fuzzy Logic and Intelligent Systems. 2013;13(2):140-6.

Robertson A. R. The CIE 1976 color-difference formulae. Color Research and Application. 1977;2(1):7-11.

Rother C., Kolmogorov V., Blake A. Grabcut: interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics. 2004;23(3):309-14.

Saric S., Bab-Hadiashar A., Hoseinnezhad R., Hocking I. Analysis of forklift accident trends within Victorian industry (Australia). Safety Science. 2013;60:176-84.

Scholkopf B., Smola A. J. Learning with kernels: support vector machines, regularization, optimization, and beyond.. 2002.

Shi J., Tomasi C. Good features to track.. 1994.

Sun E., Ma R. The UWB based forklift trucks indoor positioning and safety management system.. 2017:86-90.

Thrun S., Pratt L. Learning to learn.. 2012.

Veeraraghavan H., Masoud O., Papanikolopoulos N. P. Computer vision algorithms for intersection monitoring. IEEE Transactions on Intelligent Transportation Systems. 2003;4(2):78-89.

vom Stein A. M., Dorofeev A., Fottner J. Visual collision warning displays in industrial trucks.. 2018:1-7.

Walter M., Antone M., Chuangsuwanich E., Correa A., Davis R., Fletcher L., Frazzoli E., Friedman Y., Glass J., How J., Jeon J., Karaman S., Luders B., Roy N., Tellex S., Teller S. A situationally aware voice‐commandable robotic forklift working alongside people in unstructured outdoor environments. Journal of Field Robotics. 2014;32(4):590-628.

5f7b662f0e8825ed1d67ca73 gp Articles

Gest. Prod.

Share this page
Page Sections