MNIST op modeling - relu (PoC)

[skrsticTT]

Idea
The main goal of this task is to model relu op - in other words, we want to provide an estimation mechanism that will gave as a fast way to predict how long some relu op with the specific configuration will last (tensor size, tensor layout, data format...).

Modeling
Hypothesis is that relu op duration can be estimated with linear model. We need to measure training data that will provide us a proper fit, and than use that coefficients to estimate required op. Testing data needs to be segmented - every segment is going to have their coefficients.

Error
Also, we need to provide an expected error for this op, to make sure that Optimizer can be aware of how good this estimation is.

Some insights and results are going to be provided in the comment section.