English

冯帅章(合作者:Yuanyuan Chen, James J. Heckman, Tim Kautz),"Sensitivity of Self-Reported Noncognitive Skills to Survey Administration Conditions," Proceedings of the National Academy of Sciences of the United States of America (2020)

2020-08-01
摘要Sensitivity of Self-Reported Noncognitive Skills to Survey Administration Conditions

近日,我院院长冯帅章教授的合作论文“Sensitivity of Self-Reported Noncognitive Skills to Survey Administration Conditions”(合作者:Yuanyuan Chen, James J. Heckman, Tim Kautz)被国际顶级期刊Proceedings of the National Academy of Sciences of the United States of America (PNAS) 接受发表。

Abstract:

Noncognitive skills (e.g., persistence and self-control) are typically measured using self-reported questionnaires in which respondents rate their own skills. In many applications—including program evaluation and school accountability systems—such reports are assumed to measure only the skill of interest. However, self-reports might also capture other dimensions aside from the skill, such as aspects of a respondent’s situation, which could include incentives and the conditions in which they complete the questionnaire. To explore this possibility, this study conducted 2 experiments to estimate the extent to which survey administration conditions can affect student responses on noncognitive skill questionnaires. The first experiment tested whether providing information about the importance of noncognitive skills to students directly affects their responses, and the second experiment tested whether incentives tied to performance on another task indirectly affect responses. Both experiments suggest that self-reports of noncognitive skills are sensitive to survey conditions. The effects of the conditions are relatively large compared with those found in the program evaluation literature, ranging from 0.05 to 0.11 SDs. These findings suggest that the effects of interventions or other social policies on self-reported noncognitive skills should be interpreted with caution.




返回