Propensity score matching helps to understand sources of DIF and mathematics performance differences of Indonesian, Turkish, Australian, and Dutch students in PISA

Serkan Arikan, Fons van de Vijver, Kutlay Yagmur

Research output: Contribution to journalArticleScientificpeer-review

229 Downloads (Pure)

Abstract

We examined Differential Item Functioning (DIF) and the size of cross-cultural performance differences in the Programme for International Student Assessment (PISA) 2012 mathematics data before and after application of propensity score matching. The mathematics performance of Indonesian, Turkish, Australian, and Dutch students on released items was compared. Matching variables were gender, an index of economic, social and cultural status, and opportunity to learn, in exact, nearest neighbor, and optimal matching. Logistic regression and structural equation modeling were used to identify DIF. If propensity scores were used in the DIF analyses as performance predictors, much less DIF was found than in the original data; similarly, when in tests of country differences in mathematics performance, propensity scores were used as covariates, effect sizes of tests of country differences were reduced substantially. We concluded that propensity scoring provided us with a new tool to better control sources of DIF and country differences in PISA mathematics performance.
Original languageEnglish
Pages (from-to)69-81
Number of pages13
JournalInternational Journal of Research in Education and Science (IJRES)
Volume4
Publication statusPublished - 15 Jan 2018

Keywords

  • Propensity score
  • Matching
  • DIF
  • PISA

Fingerprint

Dive into the research topics of 'Propensity score matching helps to understand sources of DIF and mathematics performance differences of Indonesian, Turkish, Australian, and Dutch students in PISA'. Together they form a unique fingerprint.

Cite this