[Serve] multiple submodels serve #408

Job	Run time
megatron-report-clean / clean-report	12s
flagscale-report-clean / clean-report	11s
flagscale-runner / unit-test	37s
flagscale-root / unit-test	2m 9s
megatron-dist_checkpointing / unit-test	14m 34s
megatron-data / unit-test	1m 22s
megatron-distributed / unit-test	1m 50s
megatron-root / unit-test	1m 22s
megatron-export / unit-test	59s
megatron-fusions / unit-test	49s
megatron-inference / unit-test	1m 27s
megatron-models / unit-test	1m 31s
megatron-pipeline_parallel / unit-test	1m 9s
megatron-ssm / unit-test	50s
megatron-tensor_parallel / unit-test	1m 50s
megatron-transformer / unit-test	1m 15s
megatron-transformer/moe / unit-test	11m 11s
train-aquila / functional-test	17m 27s
train-mixtral / functional-test	21m 23s
hetero_train-aquila / functional-test	35m 44s
flagscale-coverage-test / test-coverage	19s
megatron-coverage-test / test-coverage	30s
serve-build_dag / functional-test	2m 43s
all-tests	0s
	2h 1m 24s

Provide feedback