Skip to content
Research Article Open access CC BY 4.0

Development of an Automated Descriptive Text-based Scoring System

K. M. Adesiji, O. C. Agbonifo, A. T. Adesuyi, O. Olabode

Journal of Advances in Mathematics and Computer Science · pp. 1–14 · Published 28 Oct 2016

10.9734/BJMCS/2016/27558

Abstract

Computers and electronic technology today offer a very large number of ways to enrich educational assessment both in classroom and in large scale testing situations. Presently, in a large scale testing situation, scores are awarded manually. However, this system is characterized by inconsistency owing to emotional and cognitive human attributes. These can invariably damper students’ morals. Thus, a text-based scoring system based on computer technology is proposed in order to alleviate the limitations of the manual system in a large-scale testing situation. In this work, an automated descriptive text-based scoring system (ADTSS) is developed in the science and technology area. The ADTSS architecture consists three modules: the domain knowledge, text reviewer and scoring engine modules. The domain knowledge contains set of keywords that relate to terms in words, sentences that describe topic in question in the descriptive text-based system. The text reviewer appraises students’ responses, trim and format as well as maps students’ Identity to their corresponding expected responses Identity in the knowledge base. The scoring engine is divided into two components viz: the marker class and marks obtainable. The mark obtainable by student is based on Multivariate Bernoulli model. The proposed ADTSS was evaluated using the responses of 50 students in software engineering examination in Federal University of Technology Akure (FUTA). The results obtained shows 73.7% accuracy of the proposed system using mean divergence metric. The results shows that the proposed system can be used for text-based scoring because the comparative analysis between the proposed the manual scoring shows a little divergence and the problem examiner’s bias is removed.

Scoring sentence checker response classifier automated marker reviewer.

References (16)

  1. 1 Knowing What Students Know: The Science and Design of Educational Assessment
  2. 2 Automated Essay Scoring Using Bayes' Theorem
  3. 3 Automated Essay Scoring: Applications to Educational Technology
  4. 4 Computer-Based Assessment in E-Learning: A Framework for Constructing "Intermediate Constraint" Questions and Tasks for Technology Platforms
  5. 5 Automated Essay Scoring by Maximizing Human-Machine Agreement [DOI]
  6. 6 The debate on automated essay grading [DOI]
  7. 7 The Computer Moves into Essay Grading: Updating the Ancient Test.
  8. 8 Automarking: using computational linguistics to score short‚ free−text responses
  9. 9 Contrasting Automated and Human Scoring of Essays
  10. 10 Automated scoring across different modalities [DOI]
  11. 11 Hidden Markov Model Based Part of Speech Tagger for Sinhala Language [DOI]
  12. 12 AutoScor: An Automated System for Essay Questions Scoring
  13. 13 8. Large scale writing assessment [DOI]
  14. 14 The Application of Network Automated Essay Scoring System in College English Writing Course [DOI]
  15. 15 How people learn: Brain, mind, experience, and school.
  16. 16 Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing [DOI]

Cited by 4

How Reliable Is It to Automatically Score Open-Ended Items? An Application in the Turkish Language

İbrahim UYSAL, Nuri DOĞAN · Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi · 2021

Automated Essay Scoring Effect on Test Equating Errors in Mixed-format Test

İbrahim UYSAL, Nuri DOĞAN · International Journal of Assessment Tools in Education · 2021

Showing 2 of 4 known citations — external sources report more than can currently be individually listed.

Related research

Article metrics

Real usage data collected on this platform.

33

Page views

0

PDF downloads

3

Outbound clicks

4

Citations

Views over time

Views by country

Approximate, from request IP at view time — not citizenship or institution. Countries with fewer than 5 views are grouped as "Other".

Traffic sources

Referring site, by host.

Views and downloads exclude known bots/crawlers. Citations combines this platform's own DOI-resolved index with each external source's own reported total — see Cited by above for individually listed citing works. Last refreshed 0 seconds ago.