|

UPDATED: 23 AUG, 2023

Addressing Selection Bias in Computerized Adaptive Testing: A User-Wise Aggregate Influence Function Approach

by Soonwoo Kwon, Sojung Kim, Seunghyun Lee, Jin-Young Kim, Suyeong An, Kyuseok Kim

Computerized Adaptive Testing (CAT), the core technology behind R.test, adaptively selects questions that align with the test taker’s proficiency, minimizing redundancy and irrelevant questions while ensuring precise measurement. CAT relies on pre-trained item profiles, developed from extensive collections of dense item-response data. The quality of these initial profiles significantly impacts CAT’s performance.
Our paper explores the use of CAT response data collected from our service to continuously improve CAT performance. We introduce a novel debiasing method known as the User-wise Aggregate Influence Function approach (UserAIF). This method effectively mitigates the selection bias present in CAT response data, and overcomes the limitations of traditional approaches. Our experiments reveal that incorporating CAT response data through UserAIF enhances CAT performance, even with limited unbiased initial data.

/

Loading PDF…

Get your score in 40 min!

Just do 1/4 of a full test and get actionable insights.

R.test is an AI-powered diagnostic test platform that evaluates student’s test readiness. Our mission is to get rid of inefficiency and inequality from test prep industry by making assessments more adaptive, accessible, and reliable.

â“’ 2023 Riiid, Inc. All Rights Reserved

521, Teheran-ro, Gangnam-gu, Seoul, Korea

contactus@rtest.ai

||

College Board® is a trademark registered by the College Board, which is not affiliated with, and does not endorse, this website.

Neither Riiid, Inc. or R.test is affiliated with College Board® and do not have access to College Board's proprietary data.

ACT® is a registered trademark of ACT, inc. This website is not endorsed or approved by ACT, inc.

Neither Riiid, Inc. or R.test is affiliated with ACT, Inc. and do not have access to ACT’s proprietary data.

Quick Cookie Note 🍪

We use necessary cookies to make R.test work. With your consent, we'd love to use other cookies to enhance your experience and understand our website's performance better. Accept if you're okay with it. More details are available in our cookie settings.

Quick Cookie Note 🍪

We use necessary cookies to make R.test work. With your consent, we'd love to use other cookies to enhance your experience and understand our website's performance better. Accept if you're okay with it. More details are available in our cookie settings.