DeepSpeed MII v0.0.2

What's Changed

• Add pkg, versioning, formatting, etc. by @jeffra in #2
• [CI] add formatter job by @jeffra in #3
• Local deployment support by @jeffra in #4
• [docs] add basic install instructions by @jeffra in #5
• [docs] add contribution guide by @jeffra in #6
• Samyam/generic server client score by @samyam in #7
• add cache-dir, detect crash, clean-up by @jeffra in #8
• Azure local deployment by @jeffra in #9
• Changing task names to ENUM by @samyam in #10
• Samyamr/model registration by @samyam in #11
• Samyamr/add features by @samyam in #12
• Samyamr/parallelism by @samyam in #13
• Samyamr/non grpc deployment test by @samyam in #14
• Samyamr/aks examples by @samyam in #15
• Samyamr/core documentation by @samyam in #17
• Add huggingface models and tasks that use gpt2 and robert model type by @cli99 in #16
• refactor model type check and add bert by @cli99 in #19
• [docs] readme updates by @jeffra in #20
• add gpt_neo and gptj support by @cli99 in #21
• Add Pydantic for checking configurations by @mrwyattii in #28
• [config] add dtype+validation for config and pass to ds-init by @jeffra in #30
• gpt-neox support by @jeffra in #22
• Add unit tests for local deployment by @mrwyattii in #31
• Bug Fix for FP16 models by @mrwyattii in #32
• GPT-NeoX docs by @mrwyattii in #33
• Fix for GPT-NeoX model by @mrwyattii in #34
• force hf to use pytorch and not use tf by @jeffra in #36
• Enable zero inference in a separate code path from ds_optimize by @cli99 in #24
• Remove non-local deployments for upcoming release by @mrwyattii in #37
• Doc and api update by @jeffra in #39
• Add Bloom Models by @mrwyattii in #38
• Multi-batch support for text-generation by @jeffra in #40
• expose all kwargs for generate by @jeffra in #42
• AML deployment + major refactor by @jeffra in #41
• fix hyperlink to paper by @kamalkraj in #48
• Enable generation of scripts and configs for AML deployments by @mrwyattii in #55
• Fixed bigscience examples by @cderinbogaz in #53
• Allow pinning deployments to specific rank(s) by @jeffra in #56
• various clean-up by @jeffra in #59
• AML deployment improvements by @mrwyattii in #62
• update supported models by @jeffra in #63
• ds-azure as preview release by @samyam in #64
• New landing + plots by @jeffra in #65
• Landing page changes by @jeffra in #67
• Fix examples with wrong param names by @mrwyattii in #68
• add support for txt2img task by @jeffra in #57
• use the fp16 revision of SD by @jeffra in #72

New Contributors

• @cli99 made their first contribution in #16
• @kamalkraj made their first contribution in #48
• @cderinbogaz made their first contribution in #53

Full Changelog: https://github.com/microsoft/DeepSpeed-MII/commits/v0.0.2