Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

P-Values For SBC #70

Open
SamuelBrand1 opened this issue Feb 14, 2025 · 0 comments · May be fixed by #71
Open

P-Values For SBC #70

SamuelBrand1 opened this issue Feb 14, 2025 · 0 comments · May be fixed by #71
Assignees
Labels
enhancement Enhancement to existing feature or aspect of the project.

Comments

@SamuelBrand1
Copy link
Contributor

a quick implementation in julia I did https://github.com/SamuelBrand1/SBC returns the p-value of the ChiSq uniformity test on the rank statistics. This could be a handy issue/next-step to go along with the viz.

Originally posted by @SamuelBrand1 in #68 (comment)

I think adding this would be useful to the SBC feature.

The underlying result is that if the posterior sampling is recovering the underlying (marginal) prior for a parameter in an SBC trial then the rank statistics are discrete uniform on $[0,1,\dots,n]$.

This is an ideal case for a classical statistical test.

@AFg6K7h4fhy2 AFg6K7h4fhy2 changed the title p-values for SBC P-Values For SBC Feb 19, 2025
@AFg6K7h4fhy2 AFg6K7h4fhy2 linked a pull request Feb 19, 2025 that will close this issue
@AFg6K7h4fhy2 AFg6K7h4fhy2 linked a pull request Feb 19, 2025 that will close this issue
@AFg6K7h4fhy2 AFg6K7h4fhy2 self-assigned this Mar 3, 2025
@AFg6K7h4fhy2 AFg6K7h4fhy2 added the enhancement Enhancement to existing feature or aspect of the project. label Mar 3, 2025
@AFg6K7h4fhy2 AFg6K7h4fhy2 added this to the [February 24, March 7] milestone Mar 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement to existing feature or aspect of the project.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants