Simplify test matrix and remove merge queue #4209

Job	Run time
Check armv5te-unknown-linux-gnueabi	38s
Build maturin	35s
Lint	1m 9s
Test (ubuntu-latest, 3.9)	5m 44s
Test Alpine Linux	5m 26s
Test Bootstrap (ubuntu-latest)	1m 42s
Test (ubuntu-latest, 3.13)	5m 39s
Test Docker	5m 24s
Test (ubuntu-latest, pypy3.10)	5m 38s
Test Bootstrap (macos-14)	1m 43s
Test downstream - ${{ matrix.downstream.repository }}	0s
Test Bootstrap (windows-latest)	5m 36s
Test Emscripten	2m 20s
Test MSRV	39s
Test windows cross	1m 4s
Test Auditwheel (manylinux_2_28)	31s
Test Cross Compile (aarch64-unknown-linux-gnu, cp39-cp39, python3.9, ghcr.io/rust-cross/manylinux...	1m 40s
Test Cross Compile (armv7-unknown-linux-gnueabihf, cp39-cp39, python3.9, ghcr.io/rust-cross/manyl...	1m 45s
Test Cross Compile (s390x-unknown-linux-gnu, cp310-cp310, python3.10, ghcr.io/rust-cross/manylinu...	1m 39s
Test Cross Compile (aarch64-unknown-linux-gnu, pp39-pypy39_pp73, pypy3.9, ghcr.io/rust-cross/many...	1m 45s
Test Cross Compile (aarch64-unknown-linux-gnu, pp310-pypy310_pp73, pypy3.10, ghcr.io/rust-cross/m...	1m 42s
conclusion	1s
	52m 20s

Provide feedback