Exclude frozen weights from checkpoints and fix evaluation using quantized LLMs

Exclude frozen weights from checkpoints and fix evaluation using quantized LLMs #10520