Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there a way to estimate the standard errors for a linear combination of the ATE across multiple arms? #1430

Open
DanKluger opened this issue Jul 12, 2024 · 1 comment
Labels

Comments

@DanKluger
Copy link

When applying the "average_treatment_effect" function to the output of a "multi_arm_causal_forest" with K>2 arms, a table with K-1 ATEs is returned along with standard error estimates for those ATEs. I'm not sure if the covariance matrix of the K-1 ATE estimators is stored anywhere, but I was wondering if it is at all possible to obtain the standard errors for an arbitrary linear combination of the K-1 ATEs?

I am particularly motivated by an example where there are two binary treatments that take values in {0,1} and would like to estimate the interaction between the two treatments given by E[Y(1,1)-Y(0,1)-Y(1,0)+Y(0,0)]. I was able to get a point estimate of this interaction by first running "multi_arm_causal_forest" where the arms were the 4 combinations of the treatments and by afterwards taking sums and differences between the ATE estimates returned by "average_treatment_effect". However, I was unable to obtain a confidence interval for the estimated interaction. In case it is helpful for clarity, I am attaching an example of an attempt to do this on synthetic data.

Thank you very much for maintaining this useful package and for considering this query.

GithubInteractionQuestion.pdf

@mollyow
Copy link

mollyow commented Sep 6, 2024

Hi Dan!

You should be able to calculate the estimate as a linear function of doubly robust scores, which you can get from get_scores(<forest>).

You can then calculate the standard error of the estimate as sd(<linear combination of scores>)/sqrt(n).

https://gist.github.com/mollyow/a55a0342fec3a2c50c4b78b27a4a0e35

@erikcs erikcs added the question label Sep 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants