[Serve] multiple submodels serve #450

Job	Run time
megatron-report-clean / clean-report	12s
flagscale-report-clean / clean-report	11s
megatron-dist_checkpointing / unit-test	14m 27s
megatron-data / unit-test	1m 19s
megatron-root / unit-test	1m 22s
megatron-distributed / unit-test	1m 47s
megatron-export / unit-test	58s
megatron-fusions / unit-test	50s
megatron-inference / unit-test	1m 27s
megatron-models / unit-test	1m 30s
megatron-pipeline_parallel / unit-test	1m 8s
megatron-ssm / unit-test	47s
megatron-transformer / unit-test	1m 12s
megatron-tensor_parallel / unit-test	1m 47s
megatron-transformer/moe / unit-test	11m 7s
flagscale-root / unit-test	2m 12s
flagscale-runner / unit-test	36s
train-aquila / functional-test	17m 13s
train-mixtral / functional-test	22m 5s
hetero_train-aquila / functional-test	35m 14s
flagscale-coverage-test / test-coverage	32s
megatron-coverage-test / test-coverage	20s
serve-test_serve_base / functional-test	3m 2s
all-tests	0s
	2h 1m 18s

Provide feedback