Advancing Electronic Assessment
Keywords:
e-Xaminer, computer-assisted assessment, domain specific languages, HAFAAbstract
A computer-aided assessment system is presented that has been designed to produce and deliver tests to the Hellenic Air Force Academy students and assess their performance. The system is called e-Xaminer and is intended for use in both undergraduate courses and distance learning post-graduate programs of the Academy. The e-Xaminer uses meta-language concepts to automatically generate tests, based on parametrically designed questions. Tests intended for different students may entail differences in the arithmetic parameters. Additionally, different tests may be composed from different but equivalent and randomly chosen sub-questions. The system may also present each student with a scrambled sequence of the same questions, as a counter-measure against cheating. Examinations are delivered via a webbased interface; an automatically generated program marks the answers submitted by each student. e-Xaminer allows the implementation of question parameterisation and counter cheating measures, so that electronic tests become significantly different and more powerful than traditional ones. Sample problems are presented which show the additional features of the e-Xaminer, intended to facilitate the work of the course organiser in issuing and marking the tests, as well as in combating cheating. This paper focuses on some new, advanced types of questions enabled by electronic assessment; it then compares paper-and-pencil exams to electronic exams; results from a small student poll on the electronic exams are also presented. Finally, the directions for planned future work are outlined.References
The Univ. of Iowa in cooperation with HBO Systems Inc., E-Learning Assessment Summary Report, Available online at: www.hbosystems.com, 2004, retrieved on March 31, 2006.
F. Pantano-Rokou, Educational design for e-learning: models, meaning and impact on learning (in Greek), Open Education, vol. 1, pp. 45-68, 2005.
D. Vergidis, A. Lionarakis, A. Lykourgiotis, B. Makrakis and Ch. Matralis, Open and distance learning, vol. 1, Institution and Operation, Hellenic Open University, Patra (in Greek; title of book translated by authors), 1998.
E. Burns, Continuing Education drives Distance-Learning enrollment, Available online at: www.clickz.com/stats/sectors/education/article.php/3605321, retrieved on May 25, 2006.
Ch. Fidas, Ch. Tranoris, V. Kapsalis and N. Avouris, System design for synchronous support and monitoring in web-based educational systems (in Greek), Proceedings of the 3rd International Conference on Open and Distance Learning, Propombos, Athens, vol. A, pp. 577-585, 2005.
Claroline documentation, http://www.claroline.net/documentation.htm, retrieved on June 21, 2006.
Blackboard documentation, http://library.blackboard.com/docs/as/bb_academic_suite_brochure_single.pdf, retrieved on June 21, 2006.
Univ. of Loughborough CAA site, http://www.lboro.ac.uk/service/pd/caa/index.htm, retrieved on June 21, 2006.
Quia site, http://www.quia.com/company/quia-presentation.pdf, retrieved on June 21, 2006.
Test Assessments project, http://www.scribestudio.com/home/ inAction/ Flash/ss_in_action.jsp?cm=TestsAssessments_Project, retrieved on June 21, 2006.
Web CT site, http://www.webct.com, retrieved on July 10, 2006.
N. T. Doukas and A. S. Andreatos, Implementation of a Computer Aided Assessment System Based on the Domain Specific Language Approach., WSEAS Transactions on Advances in Engineering Education, vol. 3(5), pp. 382-388, 2006.
J. Salpeter, 21st Century Skills: Will Our Students Be Prepared?, http://www.techlearning.com, Oct. 2003, retrieved on March 22, 2006.
Fairtest site, http://www.fairtest.org/facts/computer.htm, retrieved on June 23, 2006.
A. D. Styliadis, I. D. Karamitsos and D. I. Zachariou, Personalized e-Learning Implementation - The GIS Case, International Journal of Computers, Communications and Control, vol. I, no. 1, pp. 59-67 (2006). http://dx.doi.org/10.15837/ijccc.2006.1.2273
A. Andreatos and N. Doukas, e-Xaminer: Electronic Examination System, Proceedings of the 3rd WSEAS / IASME International Conference on Engineering Education, Vouliagmeni, Athens, Greece, July 2006.
A. Andreatos, Distance e-learning for the Hellenic Air Force, Proceedings of EDEN'03, Rhodes, Greece, pp. 428-433, 2003.
M. Bush, Alternative marking schemes for on-line multiple choice tests, 7th Annual Conference on the Teaching of Computing, Belfast, CTI Computing 1999.
D. Spinellis, Notable design patterns for domain specific languages, Journal of Systems and Software, 56 (1), pp. 91-99, Feb. 2001.
J. F. Kurose and K. W. Ross, Computer Networking - a top-down approach featuring the Internet, 3rd ed., Addison-Wesley, 2005.
A. Angeletou et al., Assessment techniques for e-learning process, Proceedings of the 3rd International Conference on Open & Distance learning, vol. B, pp. 47-54, Patra, Greece, 2005.
D. Spinellis, P. Zaharias and A. Vrechopoulos, Coping with plagiarism and grading load: Randomized programming assignments and reflective grading, Computer Applications in Engineering Education, to appear in 2007.
R. Guidorzi and M. L. Giovannini, E-learning tools in higher education: users' opinions, Proceedings of EDEN'03, Rhodes, Greece, pp. 201-206, 2003.
Published
Issue
Section
License
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
