[go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Towards a Methodology for the Evaluation of Multimedia Geographical Information Products

  • Published:
GeoInformatica Aims and scope Submit manuscript

Abstract

The design and production of multimedia and interactive maps could seem to have more in common with video and film production than digital map production and software development. The processes employed apply different methodologies to map making and the talents and skills of the personnel involved are different, diverse and, in many cases, unlike those needed for conventional mapping. The evaluation of multimedia geographical information products could be undertaken using a different manner than that employed for evaluating conventional. This paper discusses the unique evaluation requirements for multimedia mapping and GIS products which include multimedia. It then outlines how the methods used to evaluate multimedia publications might be used as a model for developing an evaluation procedure unique to this type of contemporary mapping commodity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. C. Armenakis. “Hypermedia: An information management approach for geographic data,” GIS/LIS '93 Proceedings, ACSM-ASPRS-URISA-AM/FM: Minneapolis, Vol. 1:19–28, 1993.

    Google Scholar 

  2. P. Barker, S. Giller, S. Richards, and T. King. “The evaluation of multimedia courseware,” Proceedings of ED-MEDIA 93 World Conference on Educational Multimedia and Hypermedia, Orlando, Florida, 32–38, 1993.

  3. K. Beattie. “How to avoid inadequate evaluation of software for learning,” in K. Beattie, C. McNaught, and S. Wills, (Eds.), Interactive Multimedia in University Education: Designing for Change in Teaching and Learning. North Holland: Amsterdam, 245–258, 1994.

    Google Scholar 

  4. M. Bearman, M. Kidd, and B. Cesnik. “HIV hypermedia project: Evaluation and update,” Proceedings of the ASCILITE'95 Conference, Melbourne, 16–23, 1995.

  5. W.E. Cartwright. “The application of a new metaphor set to depict spatial information and associations,” proceedings of the 18th International Cartographic Conference, Stockholm, Sweden: International Cartographic Association, Vol. 2:654–662, 1997.

    Google Scholar 

  6. W.E. Cartwright, “Hardware, software and staffing requirements of multimedia cartography: An update,” Cartography, Vol. 25(1):67–80, 1995.

    Google Scholar 

  7. W.E. Cartwright. “Interactive multimedia and mapping,” in A. MacEachren and D.R.F. Taylor, (Eds.), Visualisation in Modern Cartography. Pergamon Press: Oxford, 61–90, 1994.

    Google Scholar 

  8. W.E. Cartwright, S. Ashdowne, A. Hardie, and S. Miller. “Investigations into the use of new media and the provision of map products,” The Globe, Australian Map Circle: Melbourne, Number 45, 1–13, 1997.

    Google Scholar 

  9. W.E. Cartwright and G.J. Hunter. “Design and authoring of interactive map products,” Geomatica, Journal of the Canadian Institute of Geomatics, Vol. 50(2):173–182, 1996.

    Google Scholar 

  10. W.E. Cartwright and G.J. Hunter. “Beyond maps: Using multimedia to enrich the use of geographic information,” Proceedings of URISA '95 Conference, San Antonio, Vol. 1:420–433, 1995.

    Google Scholar 

  11. S. Cassettari, A. Fagg, and Visvalingham, M. “Cartography and geographical information systems,” The Cartographic Journal, Vol. 29(1):51–54, 1992.

    Google Scholar 

  12. K.-T. Chang, J. Antes, and T. Lenzen. “The Effect of experience on reading topographic relief information: Analysis of performance and eye movements,” The Cartographic Journal, Vol. 22(2):88–94, 1985.

    Google Scholar 

  13. L.M. Clarke. “An experimental investigation of the communicative efficiency of point symbols on tourist maps,” The Cartographic Journal, Vol. 26(2) December:105–110, 1989.

    Google Scholar 

  14. D.E. Crane. “Future directions for GIS,” Proceedings of the 21st Annual AURISA Conference, Adelaide, Vol. 1:466–76, 1993.

    Google Scholar 

  15. D. DiBiase, A.K. MacEachren, J.B. Krygier, and C. Reeves. “Animation and the role of map design in scientific visualisation,” Cartography & Geographic Information Systems, Vol. 19(4):201–214, 1992.

    Google Scholar 

  16. F. Dorwood. “The Advantages of portable usability testing,” Proceedings OZCHI94 125–126, 1994.

  17. A.K. Edmonds. “A Methodology for the comparison and specification of the geographic information system interface,” Proceedings of the 5th International Symposium on Spatial Data Handling, Charleston, North Carolina, Vol. 1:82–90, 1992.

    Google Scholar 

  18. G. A. Elmes. “Design and implementation of a user interface for decision support in natural resource management,” GIS/LIS '91 Proceedings, Atlanta, Vol. 1:399–406, 1991.

    Google Scholar 

  19. ESRIARC News. “Philadelphia's multimedia land records system streamlines access,” Fall, 34, 1995.

  20. C.F. Ferrigno and D.A. Wiltshire. “Development and evaluation of a series of hypermedia educational systems for the earth sciences,” Proceedings of ED-MEDIA 94 — World Conference on Educational Multimedia and Hypermedia, Association for the Advancement of Computing in Education: Vancouver, 203–208, 1993.

    Google Scholar 

  21. A. Flury and K. Brassel. “Space cognition and mapping: an experiment,” Proceedings of the 13th International Cartographic Association Conference, International Cartographic Association: Morelia, Mexico, Vol. 4:605–616, 1987.

    Google Scholar 

  22. E.A. Folkers. “Evaluation... a reflection: Evaluation issues in interactive multimedia,” in K. Beattie, C. McNaught, and S. Wills, (Eds.), Interactive Multimedia in University Education: Designing for Change in Teaching and Learning. North Holland: Amsterdam, 309–311, 1994.

    Google Scholar 

  23. A. Fonseca and J. Raper. “Assessing the use of multimedia tools in the development of GIS educational materials,” Proceedings of EGIS '92 Conference, Munich, Vol. 2:1238–1245, 1992.

    Google Scholar 

  24. P. Fritze. “A visual mapping approach to the evaluation of multimedia learning materials,” in K. Beattie, C. McNaught, and S. Wills, (Eds.), Interactive Multimedia in University Education: Designing for Change in Teaching and Learning. North Holland: Amsterdam, 273–285, 1994.

    Google Scholar 

  25. K. Gooding and D. Forrest. “An examination of the difference between the interpretation of screen-based and printed maps,” The Cartographic Journal, Vol. 27(1) June:15–19, 1990.

    Google Scholar 

  26. J. Groom and Z. Kemp. “Generic multimedia facilities in geographic information systems,” in P. Fisher, (Ed.) Innovations in GIS 2, Taylor and Francis: London, 189–200, 1995.

    Google Scholar 

  27. R. Haykin. (Ed.), Multimedia Demystified. Random House: New York, 1994.

    Google Scholar 

  28. H.M. Hearnshaw and D.J. Unwin. (Eds.) Visualisation in Geographical Information Systems. John Wiley: London, 1994.

    Google Scholar 

  29. P. Hood. “Who says nintendo has to win?,” New Media, July, p. 8, 1995.

  30. R. Jacobson. “Virtual worlds: Spatial interfaces for spatial technology,” ESRIARC News, Fall, 38–39, 1995.

  31. S.J. Jodoin and D.G. McKellar. “Evaluation of optical disk technologies for the storage of military digital geographical information,” The Canadian Conference on GIS '91 Proceedings, Ottawa, Vol. 1:694–704.

  32. M.-J. Kraak. “The map beyond geographical information,” in P. Fisher (Ed.), Innovations in GIS 2. Taylor and Francis: London, 163–168, 1995.

    Google Scholar 

  33. J.B. Krygier, C. Reeves, D. DiBiase, and J. Cupp. “Multimedia in geographic education: Design, implementation and evaluation of multimedia resources for geography and earth science education,” Proceedings 17th International Cartographic Conference, International Cartographic Association: Barcelona, Vol. 2:1611–1621, 1995.

    Google Scholar 

  34. L. Lang. “GIS supports holocaust survivors video archive,” GIS World, May, 48–50, 1995.

  35. B.J. Lauer. “Mapping information on CD-ROM,” Technical papers of the 1991 ACSM-ASPRS Annual Convention, ACSM-ASPRS: Baltimore, Vol. 2:187–193, 1991.

    Google Scholar 

  36. K. Leutwyler. “The guru of cyberspace,” Scientific American, September, 40–41, 1995.

  37. S. Lewis. “Hypermedia geographical information systems,” Proceedings of EGIS '91, EGIS Foundation: Brussels, Vol. 1:637–645, 1991.

    Google Scholar 

  38. S. Lewis and D. Rhind. “Multimedia geographic information systems,” Mapping Awareness, Vol. 5(6):43–49, 1991.

    Google Scholar 

  39. E.B. MacDougall. “Exploratory analysis, dynamic statistical visualisation, and geographic information systems,” Cartography and Geographic Information Systems, Vol. 19(4):237–246, 1992.

    Google Scholar 

  40. D.M. Mark and E. Zubrow. “Join the GIS-L Electronic Community,” GIS World, may, 56–57, 1993.

  41. B.H. McCormick, T.A. DeFranti, and M.D. Brown, (Eds.), “Visualisation in scientific computing,” Computer Graphics, Vol. 21(6): 1987.

  42. C. McGuinness and V. Ross. “User interactions with alternative map displays in a GIS environment,” Proceedings 17th International Cartographic Conference, Barcelona, Vol. 2:2004–2014, 1995.

    Google Scholar 

  43. D. Medyckyj-Scott and C. Board. “Cognitive cartography: A new heart for a lost soul,” in J.C. Muller, (Ed.), Advances in Cartography. Elsevier: London, 201–230, 1991.

    Google Scholar 

  44. T. Morita. “Using the eye movement measurement method,” Proceedings of the 15th International Cartographic Association Conference, International Cartographic Association: Bournemouth, U.K., Vol. 2:886–890, 1991.

    Google Scholar 

  45. J.C. Muller. “Prospects for and impediments against a new cartography in the 1990s,” in J.C. Muller, (Ed.), Advances in Cartography. Elsevier: London, 1–14, 1991.

    Google Scholar 

  46. D.G. Myers. “The perspective for content-addressable multimedia databases,” Proceedings of the 3rd Interactive Multimedia Symposium, Perth, 280–286, 1996.

  47. N. Negroponte. “Being decimal,” Wired, November, 252, 1995a.

  48. N. Negroponte. Being Digital. Hodder and Stoughton: Rydalmere, 1995b.

    Google Scholar 

  49. G. Panagopoulou, S. Sirmakessis, and A. Tsakalidis. “Athena: Integrating GIS and multimedia technology: The design of a tourist information system for the County of Attica,” Proceedings of EGIS '94, EGIS Foundation: Paris, Vol. 1:391–400, 1994.

    Google Scholar 

  50. E. Parsons. “GIS visualisation tools for qualitative spatial information,” in P. Fisher, (Ed.), Innovations in GIS 2. Taylor and Francis: London, 201–210, 1995.

    Google Scholar 

  51. E. Parsons. “Virtual worlds technology: The ultimate GIS visualisation tool,” Proceedings of AGI '94, Association for Geographic Information: Birmingham, UK, 1994.

    Google Scholar 

  52. M.P. Peterson. “Evaluating the electronic wall map,” Proceedings 17th International Cartographic Conference, International Cartographic Association: Barcelona, Vol. 2:1665–1671, 1995.

    Google Scholar 

  53. K. Pitman. “A laboratory for the visualisation of virtual environments,” Landscape and Urban Planning, Vol. 21:327–331, 1992.

    Google Scholar 

  54. N.D. Polydorides. “An experiment in multimedia GIS: Great cities of Europe,” Proceedings of EGIS '93, EGIS Foundation: Genoa, Vol. 1:203–212, 1993.

    Google Scholar 

  55. L. Rivamonte. “A multimedia primer for GIS?,” William Mumbleau and Mark J. Salling (Eds.), URISA 1992 Annual Conference Proceedings. URISA: Washington, D.C., Vol. 3:188–199, 1992.

    Google Scholar 

  56. G. Salter. “Quantitative analysis of multimedia audit trails,” Proceedings ASCILITE'95, Australian Society for Computers in Learning in Tertiary Education: Melbourne, 456–461, 1995.

    Google Scholar 

  57. B. Schneiderman and J. Morariu. The Interactive Encyclopedia System (TIES). Department of Computer Science, University of Maryland: College Park, USA, 1986.

    Google Scholar 

  58. P. Search. “HyperGlyphs: Using design and language to define hypermedia navigation,” Proceedings of ED-MEDIA '93 World Conference on Educational Multimedia and Hypermedia, Orlando, Florida, 463–470, 1993.

  59. M. J. Shiffer. “A hypermedia implementation of a collaborative planning system,” URISA Annual Conference Proceedings, L. L. Wiggans, (Ed.) URISA: San Francisco, Vol. 3:121–135, 1991.

    Google Scholar 

  60. M. Shurtleff and R.E. Geiselman. “A human-performance based evaluation of topographic maps and map symbols with novice map users,” The Cartographic Journal, Vol. 23(1):52–5, 1985.

    Google Scholar 

  61. B. Sonne. “The progress of GIS,” Proceedings of EGIS '92 European Conference on Geographical Information Systems. EGIS Foundation: Munich, Vol. 1:9–18, 1992.

    Google Scholar 

  62. P. Sorrell. “Optimal mapping and the determination of cartographic design principles,” The Cartographic Journal, Vol. 25(2):128–38, 1988.

    Google Scholar 

  63. J. Sturges and P. Campbell. “Testing multimedia,” Proceedings ITTE 1992 Conference: Information Technology for Training and Education 573–579, 1992.

  64. D.R.F. Taylor. “A conceptual basis for cartography: New directions for the information era,” The Cartographic Journal, Vol. 28(2):213–216, 1991.

    Google Scholar 

  65. D.R.F. Taylor. “Cartography for knowledge, action and development: retrospective and prospective,” The Cartographic Journal, Vol. 31(1):52–55, 1994.

    Google Scholar 

  66. D.R.F. Taylor and A.M. MacEachren. (Eds.), Visualisation in Modern Cartography. Pergamon Press: London, 1994.

    Google Scholar 

  67. J.W. Tukey. Exploratory Data Analysis. Addison-Wesley: Reading, MA, 1977.

    Google Scholar 

  68. A.G. Turk. “Towards an understanding of human-computer interaction aspects of geographic information systems,” Cartography, Vol. 19(1):31–60, 1990.

    Google Scholar 

  69. United States Geological Survey. A Process for Evaluating Geographic Information Systems, Report 88–105, 1988.

  70. P. van Demark. “Where is desktop GIS headed?,” URISA '92 Annual Conference Proceedings, URISA: Washington, D.C., Vol. 2:55–61, 1992.

    Google Scholar 

  71. M. Visvalingam and J. D. Whyatt. “The importance of detailed specification, consistent implementation and rigorous testing of cartographic software,” Proceedings of the 15th International Cartographic Association Conference, International Cartographic Association: Bournemouth, United Kingdom, Vol. 2:856–859, 1991.

    Google Scholar 

  72. T.L. Webb. “The Windsor test: an alternative to the authenticity test for virtual reality,” Proceedings OZCHI94, 285–286, 1994.

  73. G.G. Wilkinson and P.E. Fisher. “Recent development and future trends in geo-information systems,” The Cartographic Journal, Vol. 24(1):64–70, 1987.

    Google Scholar 

  74. D.A. Wiltshire and C.F. Ferrigno. “Geomedia: A hypermedia system on earth science topics for middle school children,” Proceedings of ED-MEDIA 93—World Conference on Educational Multimedia and Hypermedia, Association for the Advancement of Computing in Education: Orlando, Florida, USA, 549–555, 1993.

    Google Scholar 

  75. C. Worth. “Problems with experimental research in map design—A case study,” The Cartographic Journal, Vol. 26(2) December:148–153, 1989.

    Google Scholar 

  76. C. Worth and N. Rossides. “A market research approach to improving the effectiveness: a comparison of two Perth street directories,” Cartography, Vol. 20(1):1–19, 1991.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Land Information, RMIT University, GPO Box 2476 V, Melbourne, VIC, 3001, Australia

    William E. Cartwright

  2. Department of Geomatics, and Center for GIS and Modelling, The University of Melbourne, Parkville, VIC, 3052, Australia

    Gary J. Hunter

Authors
  1. William E. Cartwright
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gary J. Hunter
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cartwright, W.E., Hunter, G.J. Towards a Methodology for the Evaluation of Multimedia Geographical Information Products. GeoInformatica 5, 291–315 (2001). https://doi.org/10.1023/A:1011438215072

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1011438215072

Search

Navigation