API for filplus team to pull the retrieval bot data

[xinaxu]

https://filecoinproject.slack.com/archives/C05NRCURT6K/p1692957100158189

Use or create a new materialized view for this purpose

[xmcai2016]

I am not able to see the slack message for some reason, (these messages expire after a while)
could you paste the text in the description here or summarize what is needed here / timeline? @xinaxu
Fil+ team should be encouraged to directly consume from Polybase and write their own logic to make sense of the data.

[xinaxu]

From Catalin Bara: So to sum things up, we want to persist daily data in our db and build the cumulative info ourseleves. We can work with an api that returns data in the current AWS api format, we just need to know when we run the cron job that fetches new data, how far in the past we should look to get final data.

[xinaxu]

The current API is not efficient as each request is a mongo aggregation query. The ask is to use a materialized view to reduce the db load