Show simple item record

dc.contributor.authorLieli, Robert P.
dc.contributor.authorHsu, Yu-Chin
dc.date.accessioned2023-06-16T14:43:22Z
dc.date.available2023-06-16T14:43:22Z
dc.date.issued2019
dc.identifier.issn1048-5252, 1029-0311
dc.identifier.doi10.1080/10485252.2018.1537440
dc.identifier.urihttp://hdl.handle.net/20.500.14018/13924
dc.description.abstractWe consider using the area under an empirical receiver operating characteristic curve to test the hypothesis that a predictive index combined with a range of cutoffs performs no better than pure chance in forecasting a binary outcome. This corresponds to the null hypothesis that the area in question, denoted as AUC, is 1/2. We show that if the predictive index comes from a first-stage regression model estimated over the same data set, then testing the null based on the standard asymptotic normality results leads to severe size distortion in general settings. We then analytically derive the proper asymptotic null distribution of the empirical AUC in a special case; namely, when the first-stage regressors are Bernoulli random variables. This distribution can be utilised to construct a fully in-sample test of H0:AUC=1/2 with correct size and more power than out-of-sample tests based on sample splitting, though practical application becomes cumbersome with more than two regressors.
dc.language.isoeng
dc.publisherTaylor & Francis
dc.rightsCC BY-NC-ND 4.0
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.titleUsing the area under an estimated ROC curve to test the adequacy of binary predictors
dc.typeJournal article
dc.source.journaltitleJournal of Nonparametric Statistics
dc.source.volume31
dc.source.issue1
dc.source.spage100
dc.source.epage130
dc.description.versionPublished version
refterms.dateFOA2023-06-16T14:43:22Z
dc.contributor.unitDepartment of Economics and Business
dc.source.journalabbrevJournal of Nonparametric Statistics
dc.identifier.urlhttps://www.tandfonline.com/doi/full/10.1080/10485252.2018.1537440


Files in this item

Thumbnail
Name:
Lielia-Robert_2019.pdf
Size:
2.172Mb
Format:
PDF

This item appears in the following Collection(s)

Show simple item record

CC BY-NC-ND 4.0
Except where otherwise noted, this item's license is described as CC BY-NC-ND 4.0