Support FP8 grouped GEMM with rowwise scailing #8548

Job	Run time
generate-matrix / generate	4s
pytorch/FBGEMM / manywheel-py3_9-cpu	20m 12s
pytorch/FBGEMM / manywheel-py3_9-cuda11_8	1h 25m 7s
pytorch/FBGEMM / manywheel-py3_9-cuda12_4	1h 32m 57s
pytorch/FBGEMM / manywheel-py3_9-cuda12_6	1h 33m 26s
pytorch/FBGEMM / manywheel-py3_9-rocm6_2_4	2h 1m 46s
pytorch/FBGEMM / manywheel-py3_9-rocm6_3	2h 6m 1s
pytorch/FBGEMM / upload / manywheel-py3_9-cpu	16s
pytorch/FBGEMM / upload / manywheel-py3_9-cuda11_8	20s
pytorch/FBGEMM / upload / manywheel-py3_9-cuda12_4	12s
pytorch/FBGEMM / upload / manywheel-py3_9-cuda12_6	14s
pytorch/FBGEMM / upload / manywheel-py3_9-rocm6_2_4	16s
pytorch/FBGEMM / upload / manywheel-py3_9-rocm6_3	23s
	9h 1m 14s

Provide feedback