-
Notifications
You must be signed in to change notification settings - Fork 97
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Ensemble models #66
Comments
I copy-pasted the weights: Pen_reg -0.584393293Tree -0.074509616RF 1.331785969XGB -0.001696782NN 0.328813723So indeed RF is way above all others. The problem is that to give more weight to RF, because weights sum to one, the ensemble must "short" other models. And Pen_reg is the chosen short leg. I guess one important driver which is not shown in the example is the variance of errors. I suppose that the variance of Pen_reg errors are higher than those of NN, which is why they are penalized (!) in the ensemble weights. I leave it to you to confirm that! (hopefully) |
Hi, |
There is no outside reference. Sorry for the disappointment... |
In example 11.1.2, I am not able to understand the calculation of weights on the unconstrained ensemble, if it is based on the training MAEs of the models, then RF > Pen reg > NN > and so on but the weights are not in line with this. I understand it is related to the correlation within the techniques, but if you can please elaborate it, I will highly appreciate that!.
Thanks in advance!
The text was updated successfully, but these errors were encountered: