Log in
Home  »  TESOL / TESL Issues through CALL   »   Reliability in Test Administration | TESL Issues

Reliability in Test Administration | TESL Issues

Last updated on November 26, 2019 by in TESOL / TESL Issues through CALL Category with No Comments on Reliability in Test Administration | TESL Issues, 62 Views and Reading Time: 2 minutes

Reliability

Reliability

The key feature of this important trait requires the standardization of administration and tasks as well as scoring. Reliability is the consistency of test scores across facets of the test.

Independent items or tasks in a single test should correlate with each other and the test-total score. That is, there is an assumption that items are testing the same thing, and adequately discriminating between the better and weaker students. This is technically referred to as ‘Internal Consistency’.

Moss (1994) raises the question of whether it is possible to have validity without reliability, because it has been stated in the language testing literature that without reliability, there could be no validity.

Estimates of reliability in large-scale testing are based upon four assumptions (Fulcher & Davidson, 2007):

  • Stability: The abilities of the test takers will not change dramatically over short periods of time. It is interesting to note that the scores from many large-scale educational tests are given a shelf life of two years.
  • Discrimination: Tests are constructed in such a way that they discriminate as well as possible between the better and poorer test takers, and the quality of the individual test items or tasks is dependent upon its discriminatory properties.
  • Test Length: Traditional measures of reliability are also closely tied to the length of the test. Very simply, the more items or tasks are included in the test, the higher the reliability coefficient will be. Conversely, the shorter the test, the lower it will be.
  • Homogeneity: There is also an assumption in large-scale testing that all the tasks or items measure the same construct, and so the items are related or correlated to each other. So each piece of information is independently contributing to the test score, and the test score is the best possible representation of the knowledge, ability or skills of the test taker.

Methods of estimating:

  • Test-Retest:
  • Paralleled Forms:
  • Coefficient Alpha:
  • Split
  • Kuder-Richardson:

About Dr. Mohammad Hossein Hariri Asl

Dr. Mohammad Hossein Hariri Asl is an English and Persian instructor, researcher, inventor, author, blogger, SEO expert, website developer, and the creator of LELB Society. He's got a PhD in TEFL (Teaching English as a Foreign Language). Study our guest posting guidelines for authors.

View All 3976 Posts by this Author »

We respond to all comments immediately. View the 30 newest comments and new topics in forums, or create a new topic in forums. You can also contact us to leave voice messages.

Leave a Comment