Abstract
Following the discussion we have made in Chap. 1, in this chapter, graphics recognition: graphical symbol recognition, retrieval and spotting will be discussed. It first provides a clear definition of graphical symbols and tells us where does graphics recognition lie in the DIA. It also extends its discussion to graphics recognition contests (major competitions, organized by international scientific committee in cooperation with the international association for pattern recognition (IAPR)) that have been happening since 90s to see whether the real-world problems have been addressed. Not stopping there, it also quickly explains research standpoints from the author’s point of view.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
References
P.M. Devaux, D.B. Lysak, R. Kasturi, A complete system for the intelligent interpretation of engineering drawings. Int. J. Doc. Anal. Recognit. 2(2/3), 120–131 (1999)
J. Lladós, E. Martí, J.J. Villanueva, Symbol recognition by error-tolerant subgraph matching between region adjacency graphs. IEEE Trans. Pattern Anal. Mach. Intell. 23(10), 1137–1143 (2001)
K. Ph Dosch, C. Tombre, G.Masini Ah-Soon, A complete system for analysis of architectural drawings. Int. J. Doc. Anal. Recognit. 3(2), 102–116 (2000)
E. Valveny, E. Martí, A model for image generation and symbol recognition through the deformation of lineal shapes. Pattern Recognit. Lett. 24(15), 2857–2867 (2003)
M. Delalandre, E. Valveny, T. Pridmore, D. Karatzas, Generation of synthetic documents for performance evaluation of symbol recognition & spotting systems. Int. J. Doc. Anal. Recognit. 13(3), 187–207 (2010)
L.S. de las Heras, S. Ahmed, M. Liwicki, E. Valveny, G. Sánchez, Statistical segmentation and structural recognition for floor plan interpretation. Int. J. Doc. Anal. Recognit. (IJDAR) 17(3), 221–237 (2014)
D. Camozzato, L. Dihl, I. Silveira, F. Marson, S.R. Musse, Procedural floor plan generation from building sketches. Vis. Comput. 31(6–8), 753–763 (2015)
A. Okazaki, T. Kondo, K. Mori, S. Tsunekawa, E. Kawamoto, An automatic circuit diagram reader with loop-structure-based symbol recognition. IEEE Trans. Pattern Anal. Mach. Intell. 10(3), 331–341 (1988)
Guihuan Feng, Christian Viard-Gaudin, Zhengxing Sun, On-line hand-drawn electric circuit diagram recognition using 2d dynamic programming. Pattern Recognit. 42(12), 3215–3223 (2009)
K.C. Santosh, L. Wendling, B. Lamiroy, Using spatial relations for graphical symbol description, in Proceedings of the IAPR International Conference on Pattern Recognition (IEEE Computer Society, Washington, 2010), pp. 2041–2044
K.C. Santosh, B. Lamiroy, L. Wendling, Spatio-structural symbol description with statistical feature add-on, in Graphics Recognition. New Trends and Challenges, ed. by Y.-B. Kwon, J.-M. Ogier, Lecture Notes, in Computer Science, vol. 7423, (Springer, Berlin, 2011), pp. 228–237
K.C. Santosh, Reconnaissance graphique en utilisant les relations spatiales et analyse de la forme. (Graphics recognition using spatial relations and shape analysis). PhD thesis, University of Lorraine, France, 2011
K.C. Santosh, B. Lamiroy, L. Wendling, Symbol recognition using spatial relations. Pattern Recognit. Lett. 33(3), 331–341 (2012)
K.C. Santosh, L. Wendling, B. Lamiroy, Bor: Bag-of-relations for symbol retrieval. Int. J. Pattern Recognit. Artif. Intell. 28(06), 1450017 (2014)
K.C. Santosh, B. Lamiroy, L. Wendling, Integrating vocabulary clustering with spatial relations for symbol recognition. Int. J. Doc. Anal. Recognit. 17(1), 61–78 (2014)
K.C. Santosh, L. Wendling, Graphical Symbol Recognition (Wiley, New York, 2015), pp. 1–22
K.C. Santosh, Complex and composite graphical symbol recognition and retrieval: a quick review, in Recent Trends in Image Processing and Pattern Recognition, Revised Selected Papers, ed. by K.C. Santosh, M. Hangarge, V. Bevilacqua, A. Negi. Communications in computer and information science, vol. 709 (2017), pp. 3–15
W. Min, Z. Tang, and L. Tang, Recognition of dimensions in engineering drawings based on arrowhead-match, in Proceedings of 2nd International Conference on Document Analysis and Recognition, Tsukuba (Japan) (1993), pp. 373–376
G. Priestnall, R.E. Marston, D.G. Elliman, Arrowhead recognition during automated data capture. Pattern Recognit. Lett. 17(3), 277–286 (1996)
L. Wendling, S. Tabbone, Recognition of arrows in line drawings based on the aggregation of geometric criteria using the Choquet integral, in Proceedings of 7th International Conference on Document Analysis and Recognition, Edinburgh (Scotland, UK) (2003), pp. 299–303
L. Wendling, S. Tabbone, A new way to detect arrows in line drawings. IEEE Trans. Pattern Anal. Mach. Intell. 26(7), 935–941 (2004)
K. Ng, Music manuscript tracing, in Graphics Recognition Algorithms and Applications, ed. by D. Blostein, Y.-B. Kwon (Springer, Berlin, 2002), pp. 330–342
A. Rebelo, G. Capela, J.S. Cardoso, Optical recognition of music symbols: a comparative study. Int. J. Doc. Anal. Recognit. 13(1), 19–31 (2010)
Hanan Samet, Aya Soffer, MARCO: map retrieval by content. IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 783–798 (1996)
Y.-Y. Chiang, S. Leyk, C.A. Knoblock, A survey of digital map processing techniques. ACM Comput. Surv., 47(1), 1:1–1:44 (2014)
Y.-Y. Chiang, Unlocking textual content from historical maps - potentials and applications, trends, and outlooks, in Recent Trends in Image Processing and Pattern Recognition, ed. by K.C. Santosh, M. Hangarge, V. Bevilacqua, A. Negi (Springer, Singapore, 2017), pp. 111–124
Y.-Y. Chiang, S. Leyk, N.H. Nazari, S. Moghaddam, T.X. Tan, Assessing the impact of graphical quality on automatic text recognition in digital maps. Comput. Geosci. 93(C), 21–35 (2016)
Y.-Y. Chiang, C.A. Knoblock, Recognizing text in raster maps. Geoinformatica 19(1), 1–27 (2015)
J.H. Uhl, Extracting human settlement footprint from historical topographic map series using context-based machine learning, in IET Conference Proceedings (2017), pp. 15 (6 .)–15 (6 .)(1)
G. Nagy, A. Samal, S. Seth, T. Fisher, E. Guthmann, K. Kalafala, L. Li, S. Sivasubramaniam, Y. Xu, Reading street names from maps - technical challenges, in GIS/LIS (1997)
B.B. Chaudhuri, Utpal Garain, An approach for recognition and interpretation of mathematical expressions in printed document. Pattern Anal. Appl. 3(2), 120–131 (2000)
A. Alaei, M. Delalandre, A complete logo detection/recognition system for document images, in 2014 11th IAPR International Workshop on Document Analysis Systems (2014), pp. 324–328
R. Jain, D. Doermann. Logo retrieval in document images, in 2012 10th IAPR International Workshop on Document Analysis Systems (2012), pp. 135–139
A. Alaei, P.P. Roy, U. Pal, Logo and seal based administrative document image retrieval: a survey. Comput. Sci. Rev. 22, 47–63 (2016)
M. Coustaty, Contribution à l’analyse complexe de documents anciens, application aux lettrines. (Complex analysis of historical documents, application to lettrines). Ph.D. thesis, University of La Rochelle, France, 2011
Mickaël Coustaty, Rudolf Pareti, Nicole Vincent, Jean-Marc Ogier, Towards historical document indexing: extraction of drop cap letters. IJDAR 14(3), 243–254 (2011)
M. Coustaty, K. Bertet, M. Visani, J.-M. Ogier, A new adaptive structural signature for symbol recognition by using a galois lattice as a classifier. IEEE Trans. Syst. Man Cybern. Part B 41(4), 1136–1148 (2011)
M. Clément, M. Coustaty, C. Kurtz, L. Wendling, Local enlacement histograms for historical drop caps style recognition, in 14th IAPR International Conference on Document Analysis and Recognition (2017), pp. 299–304
K.C. Santosh, Character recognition based on dtw-radon, in Proceedings of International Conference on Document Analysis and Recognition (IEEE Computer Society, 2011), pp.64–268
K.C. Santosh, Laurent Wendling, Character Recognition Based on Non-linear Multi-projection Profiles Measure (Science, Frontiers of Computer, 2015), pp. 1–13
L.A. Fletcher, R. Kasturi, A robust algorithm for text string separation from mixed text/graphics images. IEEE Trans. Pattern Anal. Mach. Intell. 10(6), 910–918 (1988)
G. Nagy, Twenty years of document image analysis in PAMI. IEEE Trans. Pattern Anal. Mach. Intell. 22(1), 38–62 (2000)
Rangachar Kasturi, Lawrence O’Gorman, Venu Govindaraju, Document image analysis: a primer. Character Recognit. 27(1), 3–22 (2002)
B.B. Chaudhuri, Digital Document Processing: Major Directions and Recent Advances (Advances in Pattern Recognition) (Springer, New York, 2006)
K. Tombre, Analysis of engineering drawings: state of the art and challenges, in Tombre, Chhabra [100], pp. 257–264
K. Tombre, Ten years of research in the analysis of graphics documents: achievements and open problems, in Proceedings of 10th Portuguese Conference on Pattern Recognition, Lisbon, Portugal (1998), pp. 11–17
J. Lladós, E. Valveny, G. Sánchez, E. Martí, Symbol recognition: current advances and perspectives, in Graphics Recognition - Algorithms and Applications, ed. by D. Blostein, Y.-B. Kwon, Lecture Notes, in Computer Science, vol. 2390, (Springer, Berlin, 2002), pp. 104–127
K. Tombre, Graphics recognition: the last ten years and the next ten years, in Proceedings of 6th IAPR International Workshop on Graphics Recognition, Hong Kong (2005), pp. 422–426
K. Tombre, Graphics recognition - what else?, in Graphics Recognition. Achievements, Challenges, and Evolution, ed. by J.-M. Ogier, W. Liu, J. Lladós, Lecture Notes, in Computer Science, vol. 6020, (Springer, Berlin, 2010), pp. 272–277
D. Doermann, K. Tombre, Handbook of Document Image Processing and Recognition (Springer, New York Incorporated, 2014)
A.K. Chhabra. Graphic symbol recognition: an overview, in Proceedings of 2nd International Workshop on Graphics Recognition, Nancy (France) (1997), pp. 244–252
D.S. Doermann, An introduction to vectorization and segmentation, in Tombre, Chhabra [100], pp. 1–8
R. Kasturi, R. Raman, C. Chennubhotla, L. O’Gorman, Document image analysis: an overview of techniques for graphics recognition, in Pre-proceedings of IAPR Workshop on Syntactic and Structural Pattern Recognition, Murray Hill, NJ (USA) (1990), pp. 192–230
A.K. Jain, R.P.W. Duin, J. Mao, Statistical pattern recognition: a review. IEEE Trans. Pattern Anal. Mach. Intell. 22(1), 4–37 (2000)
S. Loncaric, A survey of shape analysis techniques. Pattern Recognit. 31(8), 983–1001 (1998)
S. Marshall, Review of shape coding techniques. Image Vis. Comput. 7(4), 281–294 (1989)
T. Taxt, P.J. Flynn, A.K. Jain, Segmentation of document images. IEEE Trans. Pattern Anal. Mach. Intell. 11(12), 1322–1329 (1989)
Salvatore Tabbone, Laurent Wendling, Karl Tombre, Matching of graphical symbols in line-drawing images using angular signature information. Int. J. Doc. Anal. Recognit. 6(2), 115–125 (2003)
M. Delalandre, J.-Y. Ramel, N. Sidere, A semi-automatic groundtruthing framework for performance evaluation of symbol recognition and spotting systems. Lecture Notes in Computer Science, vol. 7423 (Springer, Berlin, 2013), pp. 163–172
M. Delalandre, E. Valveny, J. Lladós, Performance evaluation of symbol recognition and spotting systems: an overview, in Proceedings of International Workshop on Document Analysis Systems, ed. K. Kise, H. Sako (IEEE Computer Society, 2008), pp. 497–505
Marçal Rusiñol, Josep Lladós, A performance evaluation protocol for symbol spotting systems in terms of recognition and location indices. Int. J. Doc. Anal. Recognit. 12(2), 83–96 (2009)
GREC. International Symbol Recognition Contest at GREC 2003 (2003)
E. Valveny, Ph Dosch, Symbol recognition contest: a synthesis, in Graphics Recognition: Recent Advances and Perspectives - Selected papers from GREC’03, ed. by J. Lladós, Y.B. Kwon, Lecture Notes, in Computer Science, vol. 3088, (Springer, Berlin, 2004), pp. 368–385
S.S. Bukhari, H.S.M. Al-Khaffaf, F. Shafait, M.A. Osman, A.Z. Talib, Final report of grec’13 arc and line segmentation contest, Graphics Recognition. Current Trends and Challenges - 10th International Workshop, GREC 2013, Revised Selected Papers (2013), pp. 234–239
H.S.M. Al-Khaffaf, A.Z. Talib, M.A. Osman, Final report of grec’11 arc segmentation contest: Performance evaluation on multi-resolution scanned documents, Graphics Recognition. New Trends and Challenges - 9th International Workshop, GREC 2011, Revised Selected Papers (2011), pp. 187–197
E. Valveny, M. Delalandre, R. Raveaux, B. Lamiroy, Report on the symbol recognition and spotting contest, Graphics Recognition. New Trends and Challenges - 9th International Workshop, Revised Selected Papers (2011), pp. 198–207
H.S.M. Al-Khaffaf, A.Z. Talib, M.A. Osman, P.L. Wong, Grec’09 arc segmentation contest: performance evaluation on old documents, Graphics Recognition. Achievements, Challenges, and Evolution, 8th International Workshop, Selected Papers (2009), pp. 251–259
E. Valveny, P. Dosch, A. Fornés, S. Escalera, Report on the third contest on symbol recognition, Graphics Recognition. Recent Advances and New Opportunities, 7th International Workshop, Selected Papers (2007), pp. 321–328
F. Shafait, D. Keysers, T.M. Breuel, GREC, arc segmentation contest: evaluation of four participating algorithms. Graphics Recognition. Recent Advances and New Opportunities, 7th International Workshop. Selected Papers 2007, 310–320 (2007)
X. Hilaire, RANVEC and the arc segmentation contest: second evaluation, Graphics Recognition. Ten Years Review and Future Perspectives, 6th Internation Workshop, GREC, Hong Kong, China, August 25–26, 2005. Revised Selected Papers 2005, 362–368 (2005)
P. Dosch, E. Valveny, Report on the second symbol recognition contest, Graphics Recognition. Ten Years Review and Future Perspectives, 6th Internation Workshop, GREC 2005, Revised Selected Papers (2005), pp. 381–397
L. Wenyin, Report of the arc segmentation contest, in Graphics Recognition, Recent Advances and Perspectives, ed. by J. Lladós, Y.-B. Kwon, Lecture Notes, in Computer Science, vol. 3088, (Springer, Berlin, 2004), pp. 364–367
L. Wenyin, J. Zhai, D. Dori, Extended summary of the arc segmentation contest, in Graphics Recognition Algorithms and Applications, ed. by D. Blostein, Y.-B. Kwon, Lecture Notes, in Computer Science, vol. 2390, (Springer, Berlin, 2002), pp. 343–349
D. Elliman, Tif2vec, an algorithm for arc segmentation, in engineering drawings, in Graphics Recognition Algorithms and Applications, ed. by D. Blostein, Y.-B. Kwon, Lecture Notes, in Computer Science, vol. 2390, (Springer, Berlin, 2002), pp. 350–358
X. Hilaire, RANVEC and the Arc Segmentation Contest, in Graphics Recognition - Algorithms and Applications, ed. by D. Blostein, Y.-B. Kwon, Lecture Notes, in Computer Science, vol. 2390, (Springer, Berlin, 2002), pp. 359–364
A.K. Chhabra, I.T. Phillips, The second international graphics recognition contest—raster to vector conversion: a report, in Tombre, Chhabra [100], pp. 390–410
I.T. Phillips, J. Liang, A.K. Chhabra, R.M. Haralick, A performance evaluation protocol for graphics recognition systems (Algorithms and Systems, Second International Workshop, Selected Papers, Graphics Recognition, 1997), pp. 372–389
R. Kasturi, K. Tombre, Summary and recommendations, Graphics Recognition, Methods and Applications, First International Workshop, University Park, PA, USA, August 10-11, 1995, Selected Papers (1995), pp. 301–308
D. Dori, L. Wenyin, M. Peleg, How to win a dashed line detection contest, in Kasturi, Tombre [101], pp. 286–300
B. Kong, I.T. Phillips, R.M. Haralick, A. Prasad, R. Kasturi. A benchmark: performance evaluation of dashed-line detection algorithms, in Kasturi, Tombre [101], pp. 270–285
K. Tombre, Is graphics recognition an unidentified scientific object?, Graphics Recognition. Recent Advances and New Opportunities, 7th International Workshop, GREC 2007, Selected Papers (2007), pp. 329–334
B. Lamiroy, D.P. Lopresti, H.F. Korth, J. Heflin, How carefully designed open resource sharing can help and expand document analysis research, in Document Recognition and Retrieval XVIII, part of the IS&T-SPIE Electronic Imaging Symposium (2011), p. 78740O
B. Lamiroy, D.P. Lopresti, An open architecture for end-to-end document analysis benchmarking, in International Conference on Document Analysis and Recognition (2011), pp. 42–47
M. Tooley, D. Wyatt, Aircraft engineering principles and practice, Aircraft Electrical and Electronic Systems: Principles, Operation and Maintenance (Butterworth-Heinemann, Oxford, 2008)
K. Tombre, B. Lamiroy, Pattern recognition methods for querying and browsing technical documentation, Progress in Pattern Recognition, Image Analysis and Applications, 13th Iberoamerican Congress on Pattern Recognition (2008), pp. 504–518
J.-P. Salmon, Reconnaissance de symboles complexes. Ph.D. thesis, Institut National Polytechnique de Lorraine, 2008
FRESH. Final report on symbol recognition with evaluation of performances. Deliverable 2.4.2. - FP6-516059, 2007
M. Rusiñol, J. Lladós, Symbol Spotting in Digital Libraries: Focused Retrieval Over Graphic-Rich Document Collections (Springer, London, 2010)
M.M. Luqman, Fuzzy multilevel graph embedding for recognition, indexing and retrieval of graphic document images. Ph.D. thesis, Francois Rabelais University of Tours France and Autonoma University of Barcelona Spain, 2012
N. Nayef. Geomatric-based symbol spotting and retrieval in technical line drawings. Ph.D. thesis, University of Kaiserslautern, Germany, 2012
E. Valveny, S. Tabbone, O. Ramos, E. Philippot, Performance characterization of shape descriptors for symbol representation, Graphics Recognition, Lecture Notes in Computer Science Series (Springer, Berlin, 2007), pp. 278–287
J. Rendek, G. Masini, Ph Dosch, K. Tombre, The search for genericity in graphics recognition applications: design issues of the qgar software system, in Proceedings of the 6th IAPR International Workshop on Document Analysis Systems, Florence, (Italy). Lecture Notes in Computer Science, vol. 3163 (2004), pp. 366–377
S. Tabbone, L. Wendling, D. Zuwala, A hybrid approach to detect graphical symbols in documents, in Proceedings of International Workshop on Document Analysis Systems, ed. S. Marinai, A. Dengel. Lecture Notes in Computer Science (Springer, Berlin, 2004), pp. 342–353
R.J. Qureshi, J.-Y. Ramel, D. Barret, H. Cardot, Spotting symbols in line drawing images using graph representations, in Proceedings of IAPR International Workshop on Graphics Recognition, ed. by W. Liu, J. Lladós, J.-M. Ogier. Lecture Notes in Computer Science, vol. 5046 (Springer, Berlin, 2008), pp. 91–103
H. Bunke, P.S.P. Wang (eds.), Handbook of Character Recognition and Document Image Analysis (World Scientific, Singapore, 1997)
L.P. Cordella, M. Vento, Symbol recognition in documents: a collection of techniques? Int. J. Doc. Anal. Recognit. 3(2), 73–88 (2000)
M. Robinson, L.S. Baum, J.H. Boose, D.B. Shema, S.C. Chew, Case study: boeing intelligent graphics for airplane operations and maintenance, in Conference XML’98, Chicago, USA, 1998
S. Adam, J.M. Ogier, C. Cariou, R. Mullot, J. Labiche, J. Gardes, Symbol and character recognition: application to engineering drawings. Int. J. Doc. Anal. Recognit. 3(2), 89–101 (2000)
L. Baum, J. Boose, M. Boose, C. Chaplin, R. Provine, Extracting system-level understanding from wiring diagram manuals, in Proceedings of 5th IAPR International Workshop on Graphics Recognition, Barcelona (Spain) (2003), pp. 132–138
K. Tombre, A.K. Chhabra (eds.), Graphics Recognition-Algorithms and Systems, vol. 1389 (Lecture Notes in Computer Science (Springer, Berlin, 1998)
R. Kasturi, K. Tombre (eds.), Graphics Recognition-Methods and Applications, vol. 1072 (Lecture Notes in Computer Science (Springer, Berlin, 1996)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Santosh, K.C. (2018). Graphics Recognition. In: Document Image Analysis. Springer, Singapore. https://doi.org/10.1007/978-981-13-2339-3_2
Download citation
DOI: https://doi.org/10.1007/978-981-13-2339-3_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-2338-6
Online ISBN: 978-981-13-2339-3
eBook Packages: Computer ScienceComputer Science (R0)