Defer initialization of classpath to the background if called from UI

Defer initialization of classpath to the background if called from UI #2475