no code implementations • 24 Jan 2023 • Daniel de Marchi, Matthew Welch, Michael Kosorok
In this paper we develop and present a novel theoretically justified hypothesis test of split quality for gradient boosted tree ensembles and demonstrate that using this method instead of the common penalty terms leads to a significant reduction in out of sample loss.
no code implementations • 18 Apr 2013 • Sayan Dasgupta, Yair Goldberg, Michael Kosorok
We develop an approach for feature elimination in statistical learning with kernel machines, based on recursive elimination of features. We present theoretical properties of this method and show that it is uniformly consistent in finding the correct feature space under certain generalized assumptions. We present four case studies to show that the assumptions are met in most practical situations and present simulation results to demonstrate performance of the proposed approach.