[go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

A Study of Emergency Siren Recognition on Resource-Constrained Devices

  • Conference paper
  • First Online:
Intelligent Systems (BRACIS 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13654 ))

Included in the following conference series:

  • 1077 Accesses

Abstract

The Emergency Siren Recognition (ESR) constitutes a relevant task in audio processing, which can be useful to the development of driver assistance systems or wearable devices to generate alternative alerts that make the user aware of emergency signals in the vicinity. In this context, an effective ESR solution involves deploying the model on a resource-constrained device, in which aspects such as energy consumption and memory size are critical. In this work, we studied and applied two state-of-the-art deep learning architectures to ESR: a modified version of the well-known GhostNet model, and an end-to-end 1D convolutional neural network (CNN). The performance in classification as well as computational metrics considering a low-power device (STM32F407VGT6) implementation were assessed. Distinct sampling rates, signal lengths and representations of sound were tested, considering three publicly available datasets: ESC-50, US8K and AudioSet. The best performing model on ESC-50 was GhostNet, achieving an F-Score of \(0.96 \pm 0.01\), with a Multiply-and-Accumulate Complexity (MACC) of 0.517M, whereas the 1D CNN obtained the best F-Score on US8K (\(0.93 \pm 0.05\)), with an MACC of 27.125M. Additionally, we verified that 32 filters log-Mel spectrograms on 1.5-s long signals sampled at 16000 Hz led to the best performances. Interestingly, the most efficient model was GhostNet, trained using 32 filters MFCCs, 1-s long signals with a sampling rate of 8820 Hz, which achieved an F-Score of \(0.92 \pm 0.07\) on ESC-50, just 0.04 below the best overall performance, but with a 33% lower MACC (0.347M) and \(40\%\) less running time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Abdoli, S., Cardinal, P., Lameiras Koerich, A.: End-to-end environmental sound classification using a 1D convolutional neural network. Expert Syst. Appl. 136, 252–263 (2019). https://doi.org/10.1016/j.eswa.2019.06.040,https://www.sciencedirect.com/science/article/pii/S0957417419304403

  2. Allen, J.B., Rabiner, L.R.: A unified approach to short-time Fourier analysis and synthesis. Proc. IEEE 65(11), 1558–1564 (1977)

    Article  Google Scholar 

  3. Beritelli, F., Casale, S., Russo, A., Serrano, S.: An automatic emergency signal recognition system for the hearing impaired. In: 2006 IEEE 12th Digital Signal Processing Workshop 4th IEEE Signal Processing Education Workshop, pp. 179–182 (2006). https://doi.org/10.1109/DSPWS.2006.265438

  4. Boddapati, V., Petef, A., Rasmusson, J., Lundberg, L.: Classifying environmental sounds using image recognition networks. Procedia Comput. Sci. 112, 2048–2056 (2017). https://doi.org/10.1016/j.procs.2017.08.250,https://www.sciencedirect.com/science/article/pii/S1877050917316599, knowledge-Based and Intelligent Information & Engineering Systems: Proceedings of the 21st International Conference, KES-20176-8 September 2017, Marseille, France

  5. Davis, S., Mermelstein, P.: Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences. IEEE Trans. Acoust. Speech Signal Process. 28(4), 357–366 (1980). https://doi.org/10.1109/TASSP.1980.1163420

    Article  Google Scholar 

  6. Caetano dos Santos, D.F.: Emergency siren recognition (2022). https://github.com/davifcs/acoustic_alert_detector.git

  7. Fedorov, I., Adams, R.P., Mattina, M., Whatmough, P.: Sparse: sparse architecture search for CNNs on resource-constrained microcontrollers. Adv. Neural Inf. Process. Syst. 32 (2019)

    Google Scholar 

  8. Gemmeke, J.F., et al.: Audio set: an ontology and human-labeled dataset for audio events. In: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 776–780. IEEE (2017)

    Google Scholar 

  9. Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., Xu, C.: Ghostnet: more features from cheap operations. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020)

    Google Scholar 

  10. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  11. Howard, A., et al.: Searching for mobilenetv3. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (2019)

    Google Scholar 

  12. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  13. Liaw, J.J., Wang, W.S., Chu, H.C., Huang, M.S., Lu, C.P.: Recognition of the ambulance siren sound in Taiwan by the longest common subsequence. In: 2013 IEEE International Conference on Systems, Man, and Cybernetics, pp. 3825–3828 (2013). https://doi.org/10.1109/SMC.2013.653

  14. Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017)

    Google Scholar 

  15. Linux Foundation: Open neural network exchange (2022). https://onnx.ai/

  16. Meucci, F., Pierucci, L., Del Re, E., Lastrucci, L., Desii, P.: A real-time siren detector to improve safety of guide in traffic environment. In: 2008 16th European Signal Processing Conference, pp. 1–5 (2008)

    Google Scholar 

  17. Miyazakia, T., Kitazonoa, Y., Shimakawab, M.: Ambulance siren detector using FFT on DSPIC. In: Proceedings of the 1st IEEE/IIAE International Conference on Intelligent Systems and Image Processing, pp. 266–269 (2013)

    Google Scholar 

  18. Mohaimenuzzaman, M., Bergmeir, C., West, I.T., Meyer, B.: Environmental sound classification on the edge: a pipeline for deep acoustic networks on extremely resource-constrained devices. arXiv preprint arXiv:2103.03483 (2021)

  19. Müller, M.: Information Retrieval for Music and Motion. Springer, Berlin Heidelberg (2007). https://doi.org/10.1007/978-3-540-74048-3, https://books.google.com.br/books?id=kSzeZWR2yDsC

  20. O’Shaughnessy, D.: Speech Communication: Human and Machine. Addison-Wesley series in electrical engineering, Addison-Wesley Publishing Company (1987). https://books.google.com.br/books?id=mHFQAAAAMAAJ

  21. Padhy, S., Tiwari, J., Rathore, S., Kumar, N.: Emergency signal classification for the hearing impaired using multi-channel convolutional neural network architecture. In: 2019 IEEE Conference on Information and Communication Technology, pp. 1–6. IEEE (2019)

    Google Scholar 

  22. Padhy, S., Tiwari, J., Rathore, S., Kumar, N.: Emergency signal classification for the hearing impaired using multi-channel convolutional neural network architecture. In: 2019 IEEE Conference on Information and Communication Technology, pp. 1–6 (2019). https://doi.org/10.1109/CICT48419.2019.9066252

  23. Park, S.W., Trevino, J.: Automatic detection of emergency vehicles for hearing impaired drivers. Texas A &M Univ.-Kingsville EE/CS Dept. MSC 192, 637–665 (2013)

    Google Scholar 

  24. Paszke, A., et al.: Pytorch: an imperative style, high-performance deep learning library. Adv. Neural Inf. Process. Syst. 32 (2019)

    Google Scholar 

  25. Piczak, K.J.: ESC: dataset for environmental sound classification. In: Proceedings of the 23rd ACM international conference on Multimedia, pp. 1015–1018 (2015)

    Google Scholar 

  26. Salamon, J., Jacoby, C., Bello, J.P.: A dataset and taxonomy for urban sound research. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 1041–1044. MM 2014, Association for Computing Machinery, New York, NY, USA (2014). https://doi.org/10.1145/2647868.2655045

  27. Smith, J.O.: Spectral audio signal processing (2022). http://ccrma.stanford.edu/~jos/sasp/. 2011 edition

  28. STMicroeletronics: STM32F405xx STM32F407xx - Datasheet - production data (2020)

    Google Scholar 

  29. STMicroeletronics: Getting started with X-CUBE-AI Expansion Package for Artificial Intelligence (AI) (2022)

    Google Scholar 

  30. Tan, M., Le, Q.: Efficientnet: rethinking model scaling for convolutional neural networks. In: International Conference on Machine Learning, pp. 6105–6114. PMLR (2019)

    Google Scholar 

  31. Tokozume, Y., Ushiku, Y., Harada, T.: Learning from between-class examples for deep sound recognition. arXiv preprint arXiv:1711.10282 (2017)

  32. Tran, V.T., Tsai, W.H.: Acoustic-based emergency vehicle detection using convolutional neural networks. IEEE Access 8, 75702–75713 (2020). https://doi.org/10.1109/ACCESS.2020.2988986

    Article  Google Scholar 

  33. Yang, Y.Y., et al.: Torchaudio: building blocks for audio and speech processing. arXiv preprint arXiv:2110.15018 (2021)

  34. Zhang, Y., Suda, N., Lai, L., Chandra, V.: Hello edge: keyword spotting on microcontrollers (2017). https://doi.org/10.48550/ARXIV.1711.07128, https://arxiv.org/abs/1711.07128

Download references

Author information

Authors and Affiliations

  1. University of Campinas, Av. Albert Einstein, 400, Campinas, SP, 13083-852, Brazil

    Davi Francisco Caetano dos Santos & Levy Boccato

Authors
  1. Davi Francisco Caetano dos Santos
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Levy Boccato
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Davi Francisco Caetano dos Santos .

Editor information

Editors and Affiliations

  1. Federal University of Rio Grande do Norte, Natal, Brazil

    João Carlos Xavier-Junior

  2. Federal University of Bahia, Salvador, Brazil

    Ricardo Araújo Rios

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Caetano dos Santos, D.F., Boccato, L. (2022). A Study of Emergency Siren Recognition on Resource-Constrained Devices. In: Xavier-Junior, J.C., Rios, R.A. (eds) Intelligent Systems. BRACIS 2022. Lecture Notes in Computer Science(), vol 13654 . Springer, Cham. https://doi.org/10.1007/978-3-031-21689-3_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-21689-3_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-21688-6

  • Online ISBN: 978-3-031-21689-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics