Fixed various issues introduced in the env infra refactor #5221

Job	Run time
build (X64, Release, ubuntu-latest)	2m 23s
build (X64, Trace, ubuntu-latest)	2m 23s
build (X64, Box32, ubuntu-latest)	2m 25s
build (RISCV, Release, ubuntu-latest)	8m 15s
build (RISCV, Trace, ubuntu-latest)	9m 27s
build (RISCV, StaticBuild, ubuntu-latest)	5m 42s
build (RISCV, Box32, ubuntu-latest)	9m 6s
build (RK3588, Release, ubuntu-22.04-arm)	3m 24s
build (RK3588, Trace, ubuntu-22.04-arm)	3m 35s
build (RK3588, StaticBuild, ubuntu-22.04-arm)	1m 46s
build (RK3588, Box32, ubuntu-22.04-arm)	3m 25s
build (ARM64, Release, ubuntu-22.04-arm)	3m 29s
build (ARM64, Trace, ubuntu-22.04-arm)	3m 48s
build (ARM64, StaticBuild, ubuntu-22.04-arm)	1m 46s
build (ARM64, Box32, ubuntu-22.04-arm)	3m 36s
build (ANDROID, Release, ubuntu-latest)	2m 25s
build (ANDROID, Trace, ubuntu-latest)	2m 38s
build (TERMUX, Release, ubuntu-latest)	2m 25s
build (TERMUX, Trace, ubuntu-latest)	2m 24s
build (LARCH64, Release, ubuntu-latest)	4m 15s
build (LARCH64, Trace, ubuntu-latest)	4m 36s
build (LARCH64, StaticBuild, ubuntu-latest)	2m 8s
build (LARCH64, Box32, ubuntu-latest)	4m 16s
build (ANDROID_GLIBC, Release, ubuntu-22.04-arm)	3m 34s
build (ANDROID_GLIBC, Trace, ubuntu-22.04-arm)	3m 24s
build (ANDROID_GLIBC, StaticBuild, ubuntu-22.04-arm)	1m 59s
build (ANDROID_GLIBC, Box32, ubuntu-22.04-arm)	3m 27s
	1h 42m 1s

Provide feedback