[Serve] multiple submodels serve #448

Job	Run time
megatron-report-clean / clean-report	12s
serve-test_serve_base / functional-test	33s
megatron-data / unit-test	1s
megatron-distributed / unit-test	1s
megatron-root / unit-test	1s
megatron-dist_checkpointing / unit-test	1s
megatron-export / unit-test	1s
megatron-fusions / unit-test	1s
megatron-inference / unit-test	1s
megatron-models / unit-test	1s
megatron-pipeline_parallel / unit-test	1s
megatron-ssm / unit-test	1s
megatron-tensor_parallel / unit-test	1s
megatron-transformer / unit-test	1s
megatron-transformer/moe / unit-test	1s
flagscale-report-clean	1s
flagscale-${{ (((matrix.subset == './') && 'root') \|\| matrix.subset) }}	1s
train-${{ matrix.model }}	1s
hetero_train-${{ matrix.model }}	1s
megatron-coverage-test	1s
flagscale-coverage-test	1s
all-tests	1s
	1m 5s

Provide feedback