The Effect of Item Pools of Different Strengths on the Test Results of Computerized-Adaptive Testing

Fatih KEZER

doi:https://doi.org/10.21449/ijate.735155

Article Details

The Effect of Item Pools of Different Strengths on the Test Results of Computerized-Adaptive Testing

Authors:

Fatih KEZER

Publisher:

İzzet KARA

Main Topics:

Education

Journal:

International Journal of Assessment Tools in Education 2021 Vol.8 Issue 1, pp.145-155

Document Type:

Article

Publication Date:

3/2021

Document Language:

English

Document ID (Org No.):

2000718598

Frequency:

Quarterly

eISSN:

2148-7456

DOI:

https://doi.org/10.21449/ijate.735155

Abstract:

 


Item response theory provides various important advantages for exams carried out or to be carried out digitally. For computerized adaptive tests to be able to make valid and reliable predictions supported by IRT, good quality item pools should be used. This study examines how adaptive test applications vary in item pools which consist of items with varying difficulty levels. Within the scope of the study, the impact of items was examined where the parameter b differentiates while the parameters a and c are kept in fixed range. To this end, eight different 2000-people item pools were designed in simulation which consist of 500 items with ability scores and varying difficulty levels. As a result of CAT simulations, RMSD, BIAS and test lengths were examined. At the end of the study, it was found that tests run by item pools with parameter b in the range that matches the ability level end up with fewer items and have a more accurate stimation. When parameter b takes value in a narrower range, estimation of ability for extreme ability values that are not consistent with parameter b required more items. It was difficult to make accurate estimations for individuals with high ability levels especially in test applications conducted with an item pool that consists of easy items, and for individuals with low ability levels in test applications conducted with an item pool consisting of difficult items.

.

Article Details

The Effect of Item Pools of Different Strengths on the Test Results of Computerized-Adaptive Testing

Authors: Fatih KEZER

Publisher: İzzet KARA

Main Topics: Education

Journal: International Journal of Assessment Tools in Education 2021 Vol.8 Issue 1, pp.145-155

Document Type: Article

Publication Date: 3/2021

Document Language: English

Document ID (Org No.): 2000718598

Frequency: Quarterly

eISSN: 2148-7456

DOI: https://doi.org/10.21449/ijate.735155

Issues

Authors:

Fatih KEZER

Publisher:

İzzet KARA

Main Topics:

Education

Journal:

International Journal of Assessment Tools in Education 2021 Vol.8 Issue 1, pp.145-155

Document Type:

Article

Publication Date:

3/2021

Document Language:

English

Document ID (Org No.):

2000718598

Frequency:

Quarterly

eISSN:

2148-7456

DOI:

https://doi.org/10.21449/ijate.735155