Problems with Data Quantity Statistics

[biblicabeebli]

original title: Data Quantity Statistics calculations are sometimes too low or can be reset (affects dashboard, tableau, data APIs)

I just ran data processing easy_run - which is actually just part of the normal data processing pipeline, cool - on a test participant, and the statistics on the current day of their dashboard changed substantially and got smaller.

Doesn't look like a bug in data processing, that has been running fine and is unchanged.
It should not be possible for it to have been an upload bug, I had been checking that uploading was working for at least half an hour with a then-proven-functional version of the app literally sitting in front of me.

this is somewhat outmoded as we plan to add data compression, which will change bytes, and therefore need to move to timepoints of data?

• so I guess I propose not fixing this and instead implement that.

[biblicabeebli]

@hydawo I have confirmed this. For unknown reasons data processing will sometimes screw up this value.

I don't know the underlying cause, but I can cut out the existing implementation and do a better one.

There is no way to identify how wrong the data is, we are going to need to .... reanalyze ... data things. Saw-rry.

At least it should always be displayed as too low. I will confirm that.