DeepSpeed-MII v0.2.1
What's Changed
- Update version.txt after 0.2.0 release by @mrwyattii in #382
- Error on unknown generate fields by @mrwyattii in #386
- Make the order of outputs the same as the order of inputs when using
mii.pipeline
by @s-jse in #384 - Update landing page by @mrwyattii in #391
- Update CI workflows by @loadams in #392
- Fix recovery from deadlock by @tohtana in #394
- Readable token streaming support by @greshilov in #397
- Fix generate output order by @mrwyattii in #401
- Improve recovery from KV cache starvation by @tohtana in #403
- Adding OpenAI Compatible RESTful API by @PawanOsman in #317
New Contributors
- @s-jse made their first contribution in #384
- @greshilov made their first contribution in #397
- @PawanOsman made their first contribution in #317
Full Changelog: v0.2.0...v0.2.1