Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Modernize MosaicBERT #440

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open

Modernize MosaicBERT #440

wants to merge 19 commits into from

Commits on Jan 2, 2024

  1. Modernize MosaicBERT

    @Skylion007
    Skylion007 committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    b809a7b View commit details
    Browse the repository at this point in the history

  2. Reviewer suggestions & import refactor

    @Skylion007
    Skylion007 committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    dbe8d64 View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2024

  1. Fix broken tests

    @Skylion007
    Skylion007 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    6a8d85b View commit details
    Browse the repository at this point in the history

  2. Cast to bfloat16 if possible

    @Skylion007
    Skylion007 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    4cbdec1 View commit details
    Browse the repository at this point in the history

  3. Update streaming kwarg

    @Skylion007
    Skylion007 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    6ecb798 View commit details
    Browse the repository at this point in the history

  4. Improve HALF_DTYPE selection

    @Skylion007
    Skylion007 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    eb93f3b View commit details
    Browse the repository at this point in the history

  5. revert back to old HALF selection

    @Skylion007
    Skylion007 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    58d9ffe View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2024

  1. update documentation

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    c6d58e4 View commit details
    Browse the repository at this point in the history

  2. clean up documentation

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    d5ec672 View commit details
    Browse the repository at this point in the history

  3. update yamls to mosaicml/pytorch:2.1.1_cu121-python3.10-ubuntu20.04

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    bcd10d2 View commit details
    Browse the repository at this point in the history

  4. clean up comments and documentation

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    e9e1213 View commit details
    Browse the repository at this point in the history

  5. linting

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    ea82b1b View commit details
    Browse the repository at this point in the history

  6. small formatting for pre-commit hook

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    26313a5 View commit details
    Browse the repository at this point in the history

  7. linting and type: ignore

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    329ed51 View commit details
    Browse the repository at this point in the history

  8. linting

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    95a4753 View commit details
    Browse the repository at this point in the history

  9. type ignore

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    28ccb4f View commit details
    Browse the repository at this point in the history

  10. yapf precommit hook

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    2cdb6af View commit details
    Browse the repository at this point in the history

  11. remove bug for self.slopes

    @jacobfulano
    jacobfulano committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    cb78d90 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2024

  1. remove fused_layernorm with apex dependency and include low_precision… 

    …_layernorm
    @jacobfulano
    jacobfulano committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    c44effa View commit details
    Browse the repository at this point in the history