Estimating heterogeneous treatment effects with item‐level outcome data: Insights from Item Response Theory Analyses of heterogeneous treatment effects (HTE) are common in applied causal inference research. However, when outcomes are latent variables assessed via psychometric instruments such as educationa....

New paper out today in Journal of Policy Analysis and Management: doi.org/10.1002/pam.... @itemrespwarehouse.bsky.social

20.06.2025 23:09 — 👍 1    🔁 0    💬 1    📌 0

Analysis of treatment effects on psychological networks using data from the IRW: "Our results show that causal effects on network strength are both common and uncorrelated with effects on network state." New work from @jbgilbert.bsky.social

psycnet.apa.org/doiLanding?d...

02.06.2025 18:19 — 👍 1    🔁 1    💬 0    📌 0

PRIISM | Estimating heterogeneous treatment effects with item-level data Join PRIISM and Josh Gilbert to learn how to unmask hidden treatment effects within individual test items using Item Response Theory and to understand how to overcome the limitations of traditional si...

Join us at the intersection of causal inference and psychometrics as we host Josh Gilbert (@jbgilbert.bsky.social) at the PRIISM Seminar.

Wednesday @ 10a: Estimating heterogeneous treatment effects with item-level data: Insights from Item Response Theory

steinhardt.nyu.edu/events/estim...

01.04.2025 00:43 — 👍 8    🔁 2    💬 2    📌 0

Testing Whether Reported Treatment Effects are Unduly Dependent on the Specific Outcome Measure Used This paper addresses the situation in which treatment effects are reported using educational or psychological outcome measures comprised of multiple questions or "items." A distinction is made between...

very closely related! see, e.g. arxiv.org/abs/2409.03502 and edworkingpapers.com/ai24-1082

02.04.2025 15:11 — 👍 1    🔁 0    💬 0    📌 0

The key idea is like @klint.bsky.social described. Say I have a new fractions curriculum. If I look at the impact of this curriculum on the state math test, perhaps fractions items improve but geometry items don't. So it's more about our understanding of the intervention than an individual.

02.04.2025 15:10 — 👍 0    🔁 0    💬 1    📌 0

Polytomous explanatory item response models for item discrimination: Assessing negative-framing effects in social-emotional learning surveys

New paper out yesterday in Behavior Research Methods (BRM): link.springer.com/epdf/10.3758...

@itemrespwarehouse.bsky.social

06.03.2025 13:22 — 👍 1    🔁 1    💬 0    📌 0

To any colleagues attending the @ncme38.bsky.social conference in Denver this April, I will be offering a training session on Wed. 4/23 at 1pm. Learn more at the links below:

Session Info: lnkd.in/et7P8xXS
Article: lnkd.in/e4Kawn76

05.02.2025 19:14 — 👍 3    🔁 0    💬 0    📌 0

Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory Analyses of heterogeneous treatment effects (HTE) are common in applied causal inference research. However, when outcomes are latent variables assessed via psychometric instruments such as educational...

1/ What might data-rich #psychometrics research look like? As a first example, consider @jbgilbert.bsky.social on heterogeneous treatment effects (HTE). Josh uses #irt to examine item-level HTE, with insights drawn from 75 datasets across 48 randomized trials (arxiv.org/abs/2405.00161).

12.12.2024 22:56 — 👍 6    🔁 2    💬 1    📌 1