With image obeservation

[Leong1230]

Hi, thank you for sharing the implementations!

I was encountered with memory problems when using images (128*128) as observations in my custom environment. I think the image observations should be first encoded into latent features to reduce dimensions (for reply buffer) before being inputted into the agent model. Do you have any recommoneded repo or advices in implementing this? Should the encoder model also be updated during agent training?