Thumbnail Image
Item

Inference for ROC Curves Based on Estimated Predictive Indices

Title / Series / Name
Publication Volume
Publication Issue
Pages
Authors
Hsu, Yu-Chin
Lieli, Robert P.
Editors
Keywords
Economics - Econometrics
Statistics - Methodology
Show all metadata
Files
Thumbnail Image
Lieli-Robert1_2021.pdf
Adobe PDF, 698.23 KB
URI
https://hdl.handle.net/20.500.14018/27092
Abstract
We provide a comprehensive theory of conducting in-sample statistical inference about receiver operating characteristic (ROC) curves that are based on predicted values from a first stage model with estimated parameters (such as a logit regression). The term "in-sample" refers to the practice of using the same data for model estimation (training) and subsequent evaluation, i.e., the construction of the ROC curve. We show that in this case the first stage estimation error has a generally non-negligible impact on the asymptotic distribution of the ROC curve and develop the appropriate pointwise and functional limit theory. We propose methods for simulating the distribution of the limit process and show how to use the results in practice in comparing ROC curves.
Topic
Publisher
Place of Publication
Type
Date
2021
Language
ISBN
Identifiers
10.48550/arXiv.2112.01772
Publisher link
Unit
Collections
Economics