Abstract
Ancient manuscripts written on both pages of the sheet are frequently affected by ink bleeding from the reverse side. This phenomenon produces a significant degradation of both the foreground text and the general appearance of the manuscript. Effective digital image restoration techniques may require the use of the content of both document sides, thus needing their perfect alignment. Although often available, recto and verso are usually not aligned, either for rigid misalignments occurring during acquisition, or for non-rigid deformations of the sheet. In this paper, we propose a novel method to restore color recto–verso manuscript images in a piecewise manner, without the need of a preliminary, global registration of the two sides. We assume that at the local level any deformation can be approximated by a displacement and subdivide the two images into small patches of same size. For each pair of patches at the same location, their relative shift is estimated by cross-correlation, thus allowing their straightforward alignment. A bleed-through removal algorithm is then applied to the registered patches. By spanning the entire images, this procedure returns free-of-interferences versions of the images in their original acquisition layout. The experiments show that the restoration results so obtained are better than those obtained with the classical approach that first registers the whole recto–verso pair and then performs restoration. Further advantages are a much lower computational cost, the possibility to manage non-global and non-rigid deformations, and the unaltered geometry and color appearance of the two restored images.
Similar content being viewed by others
References
Sun, B., Li, S., Zhang, X.P., Sun, J.: Blind bleed-through removal for scanned historical document image with conditional random fields. IEEE Trans. Image Process. 25(12), 5702–5712 (2016)
Tonazzini, A., Salerno, E., Bedini, L.: Fast correction of bleed-through distortion in grayscale documents by a blind source separation technique. Int. J. Doc. Anal. Recognit. 10, 17–25 (2007)
Hanasusanto, G.A., Wu, Z., Brown, M.S. : Ink-bleed reduction using functional minimization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 825–832 (2010)
Huang, Y., Brown, M.S., Xu, D.: User assisted ink-bleed reduction. IEEE Trans. Image Process. 19(10), 2646–2658 (2010)
Tonazzini, A., Gerace, I., Martinelli, F.: Multichannel blind separation and deconvolution of images for document analysis. IEEE Trans. Image Process. 19(4), 912–925 (2010)
Merrikh-Bayat, F., Babaie-Zadeh, M., Jutten, C.: Using non-negative matrix factorization for removing show-through. In: Proceedings LVA/ICA, pp. 482–489 (2010)
Moghaddam, R.F., Cheriet, M.: A variational approach to degraded document enhancement. IEEE Trans. Pattern Anal. Mach. Intell. 32(8), 1347–1361 (2010)
Almeida, M.S.C., Almeida, L.B.: Nonlinear separation of show-through image mixtures using a physical model trained with ica. Signal Process. 92, 872884 (2012)
Martinelli, F., Salerno, E., Gerace, I., Tonazzini, A.: Non-linear model and constrained ML for removing back-to-front interferences from recto–verso documents. Pattern Recognit. 45, 596–605 (2012)
Rowley-Brooke, R., Kokaram, A.: Bleed-through removal in degraded documents. In: Proceedings SPIE 8297 Document Recognition and Retrieval XIX, p. 82970T-10 (2012)
Rowley-Brooke, R., Pitié, F., Kokaram, A.C.: A non-parametric framework for document bleed-through removal. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (Online), Portland, OR, USA, 23–28 June 2013, pp. 2954–2960. https://doi.org/10.1109/CVPR.2013.380 (2013)
Tonazzini, A., Savino, P., Salerno, E.: A non-stationary density model to separate overlapped texts in degraded documents. Signal Image Video Process. 9, 155–164 (2015)
Ai, Y., Li, W., Chan, T.-H., Liao, Q.: Removal of bleed-through effect via nonnegative least-correlation. In: Proceedings of IEEE International Conference on Acoustic, Speech and Signal Processing ICASSP, pp. 2774–2778 (2014)
Dubois, E., Pathak, A.: Reduction of bleed-through in scanned manuscript documents. In: Proceedings of IS&T Image Processing, Image Quality, Image Capture Systems Conference, pp. 177–180 (2001)
Tonazzini, A., Bianco, G., Salerno, E.: Registration and enhancement of double-sided degraded manuscripts acquired in multispectral modality. In: Proceedings 10th International Conference on Document Analysis and Recognition ICDAR 2009, pp. 546 – 550 (2009)
Wang, J., Brown, M.S., Tan, C.L.: Accurate alignment of double-sided manuscripts for bleed-through removal. In: Proceedings 8-th IAPR Workshop on Document Analysis System, pp. 69–75 (2008)
Li, B., Wang, W., Ye, H.: Multi-sensor image registration based on algebraic projective invariants. Opt. Express 21, 9824–9838 (2013)
Savino, P., Tonazzini, A.: Digital restoration of ancient color manuscripts from geometrically misaligned recto–verso pairs. J. Cult. Herit. 19, 511–521 (2016)
Wang, J., Tan, C.L.: Non-rigid registration and restoration of double-sided historical manuscripts. In: Proceedings International Conference on Document Analysis and Recognition (ICDAR), p. 13741378 (2011)
Myronenko, A., Song, X.: Intensity-based image registration by minimizing residual complexity. IEEE Trans. Med. Imaging 29, 1882–1891 (2010)
Rowley-Brooke, R., Pitié, F., Kokaram, A.C.: Nonrigid recto-verso registration using page outline structure and content preserving warps. In: Proceedings of the 2nd International Workshop on Historical Document Imaging and Processing ACM, pp. 8–13 (2013)
Rowley-Brooke, R., Pitié, F., Kokaram, A.: A ground truth bleed-through document image database. In: Theory and Practice of Digital Libraries, series Lecture Notes in Computer Science, P. Z. and G. Buchanan, E. Rasmussen, and F. Loizides (eds.), vol. 7489. Springer, pp. 185–196 (2012)
Irish Script On Screen Project. http://www.isos.dias.ie (2012)
Sauvola, J., Pietikäinen, M.: Adaptive document image binarization. Pattern Recognit. 33, 225–236 (2000)
Klein, S., Staring, M., Murphy, K., Viergever, M.A., Pluim, J.: Elastix: a toolbox for intensity based medical image registration. IEEE Trans. Med. Imaging 29, 196–205 (2010)
Hanif, M., Tonazzini, A., Savino, P., Salerno, E.: Non-local sparse image inpainting for document bleed-through removal. J. Imaging 4, 68 (2018)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Savino, P., Tonazzini, A. & Bedini, L. Bleed-through cancellation in non-rigidly misaligned recto–verso archival manuscripts based on local registration. IJDAR 22, 163–176 (2019). https://doi.org/10.1007/s10032-019-00323-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10032-019-00323-2