基本信息
views: 84
![](https://originalfileserver.aminer.cn/sys/aminer/icon/show-trajectory.png)
Bio
He is interested in how statistical tools can be used to better understand psychological and educational outcomes—e.g., what is this child’s reading ability?—that are challenging to measure and yet ubiquitous in education as well as the social and biomedical sciences more generally. The following are examples of the kinds of questions that he gets excited about studying (with the essential help of many collaborators):
--As response time is collected in a broader range of psychometric studies, how should it be used? Response time is a potentially valuable piece of information about the response process but it is not always clear how it should be interpreted. One issue that we have focused on is whether the speed-accuracy tradeoff—the observation that people make more error-prone responses when hurried—arises absent priming in observational data (“Speed-accuracy tradeoff? Not so fast: Marginal changes in speed have inconsistent relationships with accuracy in real-world settings”). A related question is whether it can be potentially used to study group differences on low-stakes examinations (“Differences in time usage as a competing hypothesis for observed group differences in accuracy with an application to observed gender differences in PISA data.”).
--How can we better index prediction quality from models of binary outcomes? Our work leverages the fact that prediction quality can be translated to statements about weighted coins and introduces an index that has an interpretation which is consistently interpretable across a range of outcomes. Alongside our development of this idea in a generic setting (“InterModel Vigorish (IMV): A novel approach for quantifying predictive accuracy when outcomes are binary”), we also have done work to show how it can be used in both item response theory (“The InterModel Vigorish as a lens for understanding (and quantifying) the value of item response models for dichotomously coded items”) and structural equation models (“The InterModel Vigorish for Model Comparison in Confirmatory Factor Analysis with Binary Outcomes”).
--Can we use psychometric approaches to further our understanding of what we are learning from large experiments in education? Conventional approaches to understanding treatment effects frequently focus on outcomes that are composites of individual items. We ask whether we can identify and observe item-level variation in treatment sensitivity (“Heterogeneity of item-treatment interactions masks complexity and generalizability in randomized controlled trials”). Such variation may offer useful information about the nature of the intervention and the skills it is affecting.
--As response time is collected in a broader range of psychometric studies, how should it be used? Response time is a potentially valuable piece of information about the response process but it is not always clear how it should be interpreted. One issue that we have focused on is whether the speed-accuracy tradeoff—the observation that people make more error-prone responses when hurried—arises absent priming in observational data (“Speed-accuracy tradeoff? Not so fast: Marginal changes in speed have inconsistent relationships with accuracy in real-world settings”). A related question is whether it can be potentially used to study group differences on low-stakes examinations (“Differences in time usage as a competing hypothesis for observed group differences in accuracy with an application to observed gender differences in PISA data.”).
--How can we better index prediction quality from models of binary outcomes? Our work leverages the fact that prediction quality can be translated to statements about weighted coins and introduces an index that has an interpretation which is consistently interpretable across a range of outcomes. Alongside our development of this idea in a generic setting (“InterModel Vigorish (IMV): A novel approach for quantifying predictive accuracy when outcomes are binary”), we also have done work to show how it can be used in both item response theory (“The InterModel Vigorish as a lens for understanding (and quantifying) the value of item response models for dichotomously coded items”) and structural equation models (“The InterModel Vigorish for Model Comparison in Confirmatory Factor Analysis with Binary Outcomes”).
--Can we use psychometric approaches to further our understanding of what we are learning from large experiments in education? Conventional approaches to understanding treatment effects frequently focus on outcomes that are composites of individual items. We ask whether we can identify and observe item-level variation in treatment sensitivity (“Heterogeneity of item-treatment interactions masks complexity and generalizability in randomized controlled trials”). Such variation may offer useful information about the nature of the intervention and the skills it is affecting.
Research Interests
Papers共 163 篇Author StatisticsCo-AuthorSimilar Experts
By YearBy Citation主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
Julian M Siebert, Phaedra Bell,Nuria Gutierrez, Mónica Zegers, Eric Falke,Benjamin Domingue,Yaacov Petscher,Hugh William Catts, Lucy Yan,Lillian Durán, Gorno Tempini Maria Luisa
crossref(2024)
International journal of epidemiologyno. 3 (2024)
bioRxiv : the preprint server for biology (2024)
Psychometrika (2024)
JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS (2024)
Jennifer Guevara, Carlos Sánchez, Jessica Organista-Montaño,Benjamin W. Domingue,Nan Guo,Pervez Sultan
BJA Open (2024): 100269-100269
EDUCATIONAL MEASUREMENT-ISSUES AND PRACTICEno. 3 (2023): 50-64
Journal of Educational and Behavioral Statistics (2023)
Ellen Y Wang,Kristin M Kennedy, Lijin Zhang,Daniel Qian, Ty Forbes,Michelle Zuniga-Hernandez, Brian S-K Li,Benjamin Domingue,Thomas J Caruso
JAMIA openno. 3 (2023): ooad076-ooad076
Load More
Author Statistics
Co-Author
Co-Institution
D-Core
- 合作者
- 学生
- 导师
Data Disclaimer
The page data are from open Internet sources, cooperative publishers and automatic analysis results through AI technology. We do not make any commitments and guarantees for the validity, accuracy, correctness, reliability, completeness and timeliness of the page data. If you have any questions, please contact us by email: report@aminer.cn