Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Suggestion: Add a warning about multilevel data to Ch11 #288

Open
jmgirard opened this issue Apr 12, 2022 · 2 comments
Open

Suggestion: Add a warning about multilevel data to Ch11 #288

jmgirard opened this issue Apr 12, 2022 · 2 comments

Comments

@jmgirard
Copy link
Contributor

I love the inclusion of Chapter 11 as comparing predictive models with inferential models is something that is not done nearly enough in my field. However, I think it would be worth noting somewhere in this chapter that, if your data are multilevel, this nesting also needs to be accounted for in the inferential model. One approach would be to use cross-classified random effects (i.e., one for resample and one for cluster/multilevel-group). Eventually, it would be amazing to have {tidyposterior} intuit this nesting from your rsample object, but even still I think it is worth mentioning explicitly in the book.

@topepo
Copy link
Member

topepo commented Apr 13, 2022

We currently handle the levels of repeated CV and can add more random effect configurations for different multilevel resampling schemes.

It would be good to add an issue to tidyposterior, especially if you have resampling examples.

@jmgirard
Copy link
Contributor Author

Will do, thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants