slower on GPU using tensorflow backend?

[rayset]

I tried several machines, but with CUDA 9 and 10 it seems to be a lot slower on GPU.
Why is this the case? Am I the only one getting this behavior?

[nickion]

Given a fast CPU with all cores used, simple models tend to be faster on the CPU. I suspect the overhead of setting up the GPU becomes significant.