[luci] Support TransposeConv activation

[seanshpark]

This will revise to support TransposeConv activation.

ONE-DCO-1.0-Signed-off-by: SaeHie Park [email protected]

[seanshpark]

for #11390 , from #11387

[jinevening]

LGTM

This change seems incompatible with the September release of our backend compiler (which is synced with circle schema version 5).

[seanshpark]

This change seems incompatible with the September release of our backend compiler

Yes, our September release will go with TF2.8.0 (ONE-compiler 1.24.0).

[jinevening]

More details.

This change will make FuseActivationFunctionPass (included in O1) fuse activation functions to the preceding TConv. Our backend compiler may not handle such a model correctly.

[seanshpark]

This change will make FuseActivationFunctionPass (included in O1) fuse activation functions to the preceding TConv

In upcoming PRs, FuseActivationFunctionPass for TransposeConv will be canceled.
And XpSepActFromTransposeConvPass will be introduced to separate fused activation from TransposeConv. This Pass will be removed someday when all backends supports fused activation.