[go: up one dir, main page]
Skip to main content
SpringerLink
Log in

Fire Recognition Based On Multi-Channel Convolutional Neural Network

  • Published:
Fire Technology Aims and scope Submit manuscript

An Author Correction to this article was published on 24 January 2018

This article has been updated

Abstract

In recent years, fire recognition methods have received more and more attention in the fields of academy and industry. Current sensor-based recognition methods rely heavily on the external physical signals, which will probably reduce the recognition precision if the external environment changes dramatically. With the rapid development of high-definition camera, the methods based on image feature extraction provide another solution which tries to conduct pattern recognition for the monitoring video. However, these methods couldn’t be widely and successfully applied to fire detection due to two deficiencies: (1) there are too many interference items like lamplight and car highlight in the room or tunnel, which will disturb the recognition performance largely; (2) The features depend on much prior knowledge about flame and smoke, and there lacks a universal and automatic extraction method for various fire scenes. As a breakthrough in pattern recognition, deep learning is capable of exploring the useful information from raw data, and can automatically provide accurate recognition results. Therefore, based on deep learning idea, a novel fire recognition method based on multi-channel convolutional neural network is proposed in this paper to overcome the deficiencies mentioned above. First, three channel colorful images are constructed as the input of convolutional neural network; Second, the hidden layers with multiple-layer convolution and pooling are constructed, and simultaneously, the model parameters are find tuned by using back propagation; Finally, softmax method is used to conduct the classification about fire recognition. To save the training time, we utilize GPU to construct training and test models. From public fire dataset and Internet, we collect 7000 images for training and 4494 images for test, and then run experiments with the comparison of four baseline methods including deep neural network, support vector machine based on scale-invariant feature transform feature, stack auto-encoder and deep belief network. The experimental results show that the proposed method is more capable of restoring the features of input image by means of hidden output figure, and for various flame scenes and types, the proposed method can reach 98% or more classification accuracy, getting improvement of around 2% than the traditional feature-based method. Also, the proposed method always outperforms other Deep Learning methods in terms of ROC curve, recall rate, precision rate and F1-score.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figrue 11
Figure 12
Figure 13

Similar content being viewed by others

Change history

  • 24 January 2018

    The original version of this article unfortunately contained a mistake in “Acknowledgement” section. The funding information of “National Natural Science Foundation of China (No. U1704158)” is missing in the original publication. The corrected Acknowledgements section is given below:

References

  1. Liu B, Zhang Y, Wang D (2007) Design intelligent multi-sensor fire monitoring based on DSP. In: International conference on electronic measurement and instruments, 4-799-4-804

  2. Carter CF (2004) Fire detection sensors. US, US6818893

  3. Zhang J, Zhang H, Li M (2013) TDLAS-based early-stage forest fire detection system. For Eng 29(2):139–142

    Google Scholar 

  4. Chen S, Bao H, Zeng X, Yang Y (2003) A fire detecting method based on multi-sensor data fusion. In: Proceedings of IEEE international conference on systems, man and cybernetics, Washington, USA

  5. Li M, Xu W, Xu K, Fan J, Hou D (2013) Review of fire detection technologies based on video image. J Theor Appl Inf Technol 49(2):700–707

    Google Scholar 

  6. Enis Cetin A, Dimitropoulos K, Gouverneur B, Grammalidis N, Günay O et al (2013) Video fire detection—review. Digit Signal Proc 23(6):1827–1843

    Article  Google Scholar 

  7. Ko B, Cheong K, Nam J (2009) Fire detection based on vision sensor and support vector machines. Fire Saf J 44(3):322–329

    Article  Google Scholar 

  8. Yang B, Dong Z, Zhang Y, Zheng X (2010) Recognition of fire detection based on neural network. Lecture notes in computer science—life system modeling and intelligent computing 6329:250–258

    Article  Google Scholar 

  9. Zaidi N, Lokman N, Daud M, Chia K (2015) Fire recognition using RGB and YCbCr color space. ARPN J Eng Appl Sci 10(21):9786–9790

    Google Scholar 

  10. Qiang Y, Pei B, Zhao J (2014) Forest fire image intelligent recognition based on the neural network. J Multimed 9(3):449–455

    Article  Google Scholar 

  11. Kong SG, Jin D, Li S, Kim H (2016) Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Saf J 79:37–43

    Article  Google Scholar 

  12. Zhang Z, Shen T, Zou J (2014) An improved probabilistic approach for fire detection in videos. Fire Technol 50(3):745–752

    Article  Google Scholar 

  13. Chu YY, Kodur VKR, Liang D (2017) A probabilistic inferential algorithm to determine fire source location based on inversion of multidimensional fire parameters. Fire Technol 53(3):1077–1100

    Article  Google Scholar 

  14. Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117

    Article  Google Scholar 

  15. Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25(2):1097–1105

    Google Scholar 

  16. Graves A, Mohamed A, Hinton GE (2013) Speech recognition with deep recurrent neural networks. In: Proceedings of 2013 IEEE international conference on acoustics, speech and signal processing (ICASSP), Vancouver, BC, Canada, pp 6645-6649

  17. Mamoshina P, Vieira A, Putin E, Zhavoronkov A (2016) Applications of deep learning in biomedicine. Mol Pharm 13(5):1445–1454

    Article  Google Scholar 

  18. Yu C, Fang J, Wang J, Zhang Y (2010) Video fire smoke detection using motion and color features.Fire Technol 46(3):651–663

    Article  Google Scholar 

  19. Fang J, Wang J, Yu C, Zhang Y (2009) Texture analysis of smoke for real-time fire detection. In: Proceeding of international workshop on computer science and engineering (IWCSE), Qingdao, China, pp 511–515

  20. Zhou Q, Yang X, Bu L (2015) Analysis of shape features of flame and interference image in video fire detection. In: Proceeding of 2015 Chinese Automation Congress

  21. Uqur Töreyin B, Gokberk Cinbis R, Dedeoglu Y, Enis Cetin A (2007) Fire detection in infrared video using wavelet analysis.Opt Eng 46(6):067204

    Article  Google Scholar 

  22. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324

    Article  Google Scholar 

  23. Rumelhart D, Hinton G, Williams R (1986) Learning representations by back-propagating errors. Nature 323:533–536

    Article  MATH  Google Scholar 

  24. Lee V, Kim C, Chhugani J, Deisher M, Kim D et al. (2010) Debunking the 100x GPU vs. CPU myth: an evaluation of throughput computing on CPU and GPU. ACM Sigarch Comput Archit News 38(3):451–460

    Article  Google Scholar 

  25. Chollet F (2015) Keras: The python deep learning library. GitHub. https://github.com/fchollet/keras

  26. Al-Rfou R, Alain G, Almahairi A et al (2016) Theano: a python framework for fast computation of mathematical expression. arXiv e-prints. http://arxiv.org/abs/1605.02688

  27. Enis Cetin A (2017) VisiFire: Computer vision based fire detection dataset. http://signal.ee.bilkent.edu.tr/VisiFire/index.html. Accessed 5 Oct 2017

  28. Hinton GE, Li D, Dong Y et al (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 29(6):82–97

    Article  Google Scholar 

  29. Mao W, Wang W, Jiang M, Ouyang J (2016) Fast flame recognition approach based on local feature filtering. J Comput Appl 36(10):2907–2911. (in Chinese)

    Google Scholar 

  30. Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol P (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11(12):3371–3408

    MathSciNet  MATH  Google Scholar 

  31. Suk H, Lee S, Shen D (2015) Latent feature representation with stacked auto-encoder for AD/MCI diagnosis. Brain Struct Funct 220(2):841–859

    Article  Google Scholar 

  32. Mao W, He J, Li Y, Yan Y (2017) Bearing fault diagnosis with auto-encoder extreme learning machine: a comparative study. Proc Inst Mech Eng Part C J Mech Eng Sci 231(8):1560–1578

    Article  Google Scholar 

  33. Hinton GE, Osindero S, Teh Y (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527–1554

    Article  MathSciNet  MATH  Google Scholar 

  34. Kuremoto T, Kimura S, Kobayashi K, Obayashi M (2014) Time series forecasting using a deep belief network with restricted Boltzmann machines. Neurocomputing 137:47–56

    Article  Google Scholar 

  35. Ranzato M, Boureau Y, LeCun Y (2008) Sparse feature learning for deep belief networks. Adv Neural Inf Process Syst ;20: 1185-1192

    Google Scholar 

Download references

Acknowledgements

This work was supported by China Postdoctoral Science Foundation Special Support (No. 2016T90944), the funding scheme of University Science & Technology Innovation in Henan Province (15HASTIT022), the funding scheme of University Young Core Instructor in Henan Province (2014GGJS-046) and the foundation of Henan Normal University for Excellent Young Teachers (No.14YQ007).

Author information

Authors and Affiliations

  1. Henan Normal University, Xinxiang, China

    Wentao Mao, Wenpeng Wang, Zhi Dou & Yuan Li

Authors
  1. Wentao Mao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wenpeng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhi Dou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yuan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wentao Mao.

Additional information

A correction to this article is available online at https://doi.org/10.1007/s10694-018-0705-3.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mao, W., Wang, W., Dou, Z. et al. Fire Recognition Based On Multi-Channel Convolutional Neural Network. Fire Technol 54, 531–554 (2018). https://doi.org/10.1007/s10694-017-0695-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10694-017-0695-6

Keywords

Search

Navigation