Train Melband on 3090

[lucellent]

Is it possible to reduce some aspects of Melband to give good results still but be able to train on smaller GPUs?

I have tried finetuning Kimberley's model with my 3090 but with each epoch the results get slightly worse. This is with only audio chunk size reduced to about half and batch size 1-2 (regardless of accum grad)