Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

integrate zonal with OnlineStats #818

Open
asinghvi17 opened this issue Nov 10, 2024 · 5 comments
Open

integrate zonal with OnlineStats #818

asinghvi17 opened this issue Nov 10, 2024 · 5 comments
Labels
enhancement New feature or request

Comments

@asinghvi17
Copy link
Collaborator

https://github.com/joshday/OnlineStats.jl

deepcopy works on any online stat, so we can deepcopy the passed in stats and then fit! into them as part of the zonal. This can be in a package extension.

Interest?

@asinghvi17 asinghvi17 added the bug Something isn't working label Nov 10, 2024
@asinghvi17
Copy link
Collaborator Author

This would enable e.g zonal(Series(KahanSum(), Variance(), ExpandingHist(500)), raster; of = geoms).

@asinghvi17
Copy link
Collaborator Author

But also the ability to do running means, etc. Not sure if this is a great idea, but thought I'd put it up for discussion.

@felixcremer
Copy link
Contributor

You might want to look at the integration of online stats into YAXArrays. There it is not used for zonal, but for table aggregation.

@rafaqz
Copy link
Owner

rafaqz commented Nov 10, 2024

Would be cool to integrate diskarrays chunks, is that what you mean?

@asinghvi17
Copy link
Collaborator Author

More that we could do zonal(OnlineStats.KahanSum(), ras; of = geoms) and have it return one of:

  • value(stat): a number
  • stat: an OnlineStats object

Not sure which is more valuable / sensible. But it would potentially allow us to be completely lazy and avoid materializing anything. Maybe that's the way to go...

@asinghvi17 asinghvi17 added enhancement New feature or request and removed bug Something isn't working labels Nov 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants