Abstract
Rectal tumor is a common malignancy in the intestine. The death rate of rectal tumor ranks fourth among the malignant tumors of digestive system, which seriously threaten the life and health of patients. Endoscopic ultrasonography is the most commonly used method to detect rectal tumors. After obtaining CT images, doctors diagnose the condition with the naked eye and experience, which brings a certain workload to both the doctor and the patient. With the development of in-depth learning and the continuous iterative convolution neural network, more and more techniques have been applied in the field of medical image. Therefore, this paper studies and improves an ultrasonic image segmentation U-Net model for rectal tumors based on fuzzy logic attention mechanism. This paper first preprocesses the original image, enhances the details and reduces the image size.Then the image feature map is weighted by fuzzy logic and attention mechanism. In addition, the loop-back residual mechanism is used to optimize the model. At last, the results of several models are analyzed and compared. The results show that, compared with the U-Net model, the optimized model has a nearly 3% increase in image segmentation precision, almost unchanged recall, and both IoU and Dice have increased by about 2%. Overall, the model has good segmentation performance, and the introduction of RoI aware U-Net greatly reduces the use of video memory.










Similar content being viewed by others
References
Gao, H., Zeng, X., Pan, D., & Zheng, B. (2020). Rectal tumor segmentation method based on improved u-net model. Journal of Computer Applications, 40(8), 2392–2397.
Gai, K., & Qiu, M. (2018). Optimal resource allocation using reinforcement learning for IoT content-centric services. Applied Soft Computing, 70, 12–21.
Gai, K., & Qiu, M. (2018). Reinforcement learning-based content-centric services in mobile sensing. IEEE Network, 32(4), 34–39.
Guo, Y., Zhuge, Q., Hu, J., et al. (2011). Optimal data allocation for scratch-pad memory on embedded multi-core systems. IEEE International Conference on Parallel Processing (ICPP), pp. 464–471.
Zhang, L., Qiu, M., Tseng, W., & Sha, E. (2010). Variable partitioning and scheduling for MPSoC with virtually shared scratch pad memory. Journal of Signal Processing Systems, 58(2), 247–265.
Qiu, M., Chen, Z., & Liu, M. (2014). Low-power low-latency data allocation for hybrid scratch-pad memory. IEEE Embedded Systems Letters, 6(4), 69–72.
Qiu, M., Li, H., & Sha, E. (2009). Heterogeneous real-time embedded software optimization considering hardware platform, ACM symposium on Applied Computing, pp. 1637-1641.
Qiu, M., Xue, C., Shao, Z., & Sha, E. (2007). Energy minimization with soft real-time and DVS for uniprocessor and multiprocessor embedded systems, ACM/IEEE Design, Automation, Test in Europe Conf. (DATE), pp. 1-6.
Guo, Y., Zhuge, Q., Hu, J., et al. (2013). Data placement and duplication for embedded multicore systems with scratch pad memory, IEEE Transactions on Computer-Aided Design of Integrated Circuits.
Qiu, M., Khisamutdinov, E., Zhao, Z., et al. (2013). RNA nanotechnology for computer design and in vivo computation, Philosophical Transactions of the Royal Society A.
Qiu, M., Zhang, K., & Huang, M. (2004). An empirical study of web interface design on small display devices, IEEE/WIC/ACM International Conference on Web Intelligence (WI’04), pp 29-35.
Zhang, Q., Huang, T., et al. (2013). A case study of sensor data collection and analysis in smart city, provenance in smart food supply chain. International Journal of Distributed Sensor Networks, 9(11).
Su, H., Qiu, M., & Wang, H. (2012). Secure wireless communication system for smart grid with rechargeable electric vehicles. IEEE Communications Magazine, 50(8), 62–68.
Qiu, M., Ming, Z., Wang, J., Yang, L., & Xiang, Y. (2014). Enabling cloud computing in emergency management systems. IEEE Cloud Computing, 1(4), 60–67.
Shao, Z., Wang, M., Chen, Y., et al. (2007). Real-time dynamic voltage loop scheduling for multi-core embedded systems, IEEE Transactions on Circuits and Systems II, 54 (5), 445-449.
Niu, J., Liu, C., Gao, Y., et al. (2013). Energy efficient task assignment with guaranteed probability satisfying timing constraints for embedded systems. IEEE Transactions on Parallel and Distributed Systems, 25(8), 2043–2052.
Sulaiman, S. N., & Isa, N. A. M. (2010). Adaptive fuzzy-k-means clustering algorithm for image segmentation. IEEE Transactions on Consumer Electronics, 56(4), 2661–2668.
Pal, N. R., & Pal, S. K. (1993). A review on image segmentation techniques. Pattern recognition, 26(9):1277–1294.
Wani, M. A., & Batchelor, B. G. (1994). Edge-region-based segmentation of range images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(3), 314–319.
Angelina, S., Suresh, L. P., & Veni, S. K. (2012). Image segmentation based on genetic algorithm for region growth and region merging. In: 2012 International Conference on Computing, Electronics and Electrical Technologies (ICCEET), IEEE, pp 970–974.
Ugarriza, L. G., Saber, E., Vantaram, S. R., Amuso, V., Shaw, M., & Bhaskar, R. (2009). Automatic image segmentation by dynamic region growth and multiresolution merging. IEEE Transactions on Image Processing, 18(10), 2275–2288.
Qiu, M., Cao, D., Su, H., & Gai, K. (2016). Data transfer minimization for financial derivative pricing using Monte Carlo simulation with GPU in 5G. IEEE International Journal of Communication Systems, 29(16), 2364–2374.
Liu, M., Zhang, S., et al. (2012). H Infinite State Estimation for Discrete-Time Chaotic Systems Based on a Unified Model, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 42.
Zhao, H., Chen, M., et al. (2016). A novel pre-cache schema for high performance Android system. Future Generation Computer Systems, 56, 766–772.
Lin, K., Wang, W., Bi, Y., et al. (2016). Human localization based on inertial sensors and fingerprints in the Industrial Internet of Things. Computer Networks, 101, 113–126.
Lu, Z., Wang, N., et al. (2018). IoTDeM: An IoT Big Data-oriented MapReduce performance prediction extended model in multiple edge clouds. Journal of Parallel and Distributed Computing, 118, 316–327.
Qiu, M., Liu, J., Li, J., et al. (2011). A novel energy-aware fault tolerance mechanism for wireless sensor networks, IEEE/ACM International Conference on Green Computing and Communications.
Qiu, H., Qiu, M., Memmi, G., Ming, Z., & Liu, M. (2018). A dynamic scalable blockchain based communication architecture for IoT, International Conference on Smart Blockchain, 159-166.
Zhang, Z., Wu, J., et al. (2008). Jamming ACK attack to wireless networks and a mitigation approach. IEEE GLOBECOM, pp. 1–5.
Tang, X., Li, K., et al. (2012). A hierarchical reliability-driven scheduling algorithm in grid systems. Journal of Parallel and Distributed Computing, 72(4), 525–535.
Irving, Benjamin and Cifor, Amalia and Papież, Bartłomiej W., et al. (2014). Automated colorectal tumour segmentation in DCE-MRI using supervoxel neighbourhood contrast characteristics. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp 609–616.
Van, H., Miriam, M., Lambregts, Doenja, M. J., Van ,G., Joost, J. M., Stanley, O., et al. (2016). Automated and semiautomated segmentation of rectal tumor volumes on diffusion-weighted MRI: can it replace manual volumetry? International Journal of Radiation Oncology* Biology* Physics, 94(4):824–831.
Ran, Z., Jian, J., Wang, M., Zhao, X., & Gao, X. (2019). Automatic segmentation of tumor magnetic resonance imaging based on full convolutional neural network. Beijing Biomedical Engineering, 38(05), 465–471.
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016). Rethinking the inception architecture for computer vision. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 2818–2826.
Alom, M. Z., Yakopcic, C., Hasan, M., Taha, T. M., & Asari, V. K. (2019). Recurrent residual U-Net for medical image segmentation. Journal of Medical Imaging, 6(1).
Xu, Z., Wang, S., Stanislawski, L. V., Jiang, Z., Jaroenchai, N., Sainju, A. M., et al. (2021). An attention u-net model for detection of fine-scale hydrologic streamlines. Environmental Modelling & Software, 140,.
Fan, J., Yau, D. K., Elmagarmid, A. K., & Aref, W. G. (2001). Automatic image segmentation by integrating color-edge extraction and seeded region growing. IEEE transactions on image processing, 10(10), 1454–1466.
Ma, W. Y., & Manjunath, B. (1997). Edge flow: a framework of boundary detection and image segmentation. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE, pp 744–749.
Tabb, M., & Ahuja, N. (1997). Multiscale image segmentation by integrated edge and region detection. IEEE Transactions on Image Processing, 6(5), 642–655.
Aguirre, N., Grall-Maës, E., Cymberknop, L. J., & Armentano, R. L. (2021). Blood pressure morphology assessment from photoplethysmogram and demographic information using deep learning with attention mechanism. Sensors, 21(6), 2167.
Sahu, R. K., Müller, J., Park, J., Varadharajan, C., Arora, B., Faybishenko, B., & Agarwal, D. (2020). Impact of input feature selection on groundwater level prediction from a multi-layer perceptron neural network. Frontiers in Water, 2, 46.
Guo, J., Li, Y., Lin, W., Chen, Y., & Li, J. (2018). Network decoupling: From regular to depthwise separable convolutions. arXiv preprint arXiv:180805517.
Jang, J. S. (1993). Anfis: adaptive-network-based fuzzy inference system. IEEE Transactions on Systems, Man, and Cybernetics, 23(3), 665–685.
Kalambet, Y., Kozmin, Y., Mikhailova, K., Nagaev, I., & Tikhonov, P. (2011). Reconstruction of chromatographic peaks using the exponentially modified Gaussian function. Journal of Chemometrics, 25(7), 352–356.
Wang, Q., & Luo, L. (2021). Sequential fault detection and classification in chemical process using a deep convolutional encoder-decoder architecture based on system dynamics. In: IOP Conference Series: Earth and Environmental Science, IOP Publishing, vol 696, p 012052.
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989). Backpropagation applied to handwritten zip code recognition. Neural computation, 1(4), 541–551.
Yu, H. (2019). Research on the classification of retinal diseases based on se-block. Master’s thesis, Jilin University.
Li, G., Zhang, C., Lei, R., Zhang, X., Ye, Z., & Li, X. (2020). Hyperspectral remote sensing image classification using three-dimensional-squeeze-and-excitation-densenet (3d-se-densenet). Remote Sensing Letters, 11(2), 195–203.
Axiang, Y., Chengrun, L., Shuyi, Y., & Hongjun, L. (2021). Multi-attention mechanism of mask wearing detection network. Journal of Nanjing Normal University (Engineering Technology Edition)[ISSN: 1006-6977/CN: 61-1281/TN], (1):23–29.
Tang, W. (2019). Research on liver ct image segmentation method based on deep learning. Master’s thesis, Chongqing University.
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778.
Acknowledgements
This work is supported by the National Natural Science Foundation of China (No.62072008, No.62031013).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on: Big Data Security Track
Rights and permissions
About this article
Cite this article
Zhou, F., Ye, Y. & Song, Y. Image Segmentation of Rectal Tumor Based on Improved U-Net Model with Deep Learning. J Sign Process Syst 94, 1145–1157 (2022). https://doi.org/10.1007/s11265-021-01710-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11265-021-01710-x