Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pin foundry and fix a minor yaml change with latest foundry #410

Merged
merged 4 commits into from
Jul 6, 2023
Merged

Pin foundry and fix a minor yaml change with latest foundry #410

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
35385ce
fix path
dakinggg Jul 6, 2023
25450ce
fix the pins
dakinggg Jul 6, 2023
827c39f
fix reqs
dakinggg Jul 6, 2023
d097eec
fix
dakinggg Jul 6, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions examples/end-to-end-examples/sec_10k_qa/mcli-yamls/01_process_and_upload_10ks.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,8 +10,8 @@ compute:
integrations:
# Clone the examples repository so that we have access to the code in sec_10k_qa
- integration_type: git_repo
git_repo: mosaicml/examples # TODO: CHANGE BACK TO MAIN
git_branch: main # TODO: CHANGE BACK TO MAIN
git_repo: mosaicml/examples
git_branch: main
ssh_clone: false # Should be true if using a private repo
path: /workspace/examples # Tell MCLI what path to clone the repo to

Expand Down
4 changes: 2 additions & 2 deletions examples/end-to-end-examples/sec_10k_qa/mcli-yamls/02_convert_10ks_to_mds.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,8 +10,8 @@ compute:
integrations:
# Clone the examples repository so that we have access to the code in sec_10k_qa
- integration_type: git_repo
git_repo: mosaicml/examples # TODO: CHANGE BACK TO MAIN
git_branch: main # TODO: CHANGE BACK TO MAIN
git_repo: mosaicml/examples
git_branch: main
ssh_clone: false # Should be true if using a private repo
path: /workspace/examples # Tell MCLI what path to clone the repo to

Expand Down
4 changes: 2 additions & 2 deletions examples/end-to-end-examples/sec_10k_qa/mcli-yamls/03_finetune_on_10ks.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ integrations:
# Clone and install the llm-foundry repo so we can run scripts from it
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
git_branch: main # TODO: pin
git_commit: v0.2.0
pip_install: -e .[gpu]
ssh_clone: false # Should be true if using a private repo
# Uncomment and fill in to log to WandB. Also uncomment the loggers section near the bottom of the yaml
Expand Down Expand Up @@ -197,7 +197,7 @@ parameters:
icl_tasks:
-
label: arc_easy
dataset_uri: eval/local_data/arc_easy.jsonl
dataset_uri: eval/local_data/world_knowledge/arc_easy.jsonl
num_fewshot: [0]
icl_task_type: multiple_choice
continuation_delimiter: 'Answer: '
2 changes: 1 addition & 1 deletion examples/end-to-end-examples/sec_10k_qa/mcli-yamls/04_instruction_finetune_on_dolly_hh.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ integrations:
# Clone and install the llm-foundry repo so we can run scripts from it
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
git_branch: main # TODO: pin
git_commit: v0.2.0
pip_install: -e .[gpu]
ssh_clone: false # Should be true if using a private repo
# Uncomment and fill in to log to WandB. Also uncomment the loggers section near the bottom of the yaml
Expand Down
2 changes: 1 addition & 1 deletion examples/end-to-end-examples/sec_10k_qa/mcli-yamls/05_convert_composer_to_huggingface.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ integrations:
# Clone and install the llm-foundry repo so we can run scripts from it
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
git_branch: main # TODO: pin
git_commit: v0.2.0
pip_install: -e .
ssh_clone: false # Should be true if using a private repo

Expand Down
2 changes: 1 addition & 1 deletion examples/end-to-end-examples/sec_10k_qa/requirements-cpu.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
langchain==0.0.205
composer[streaming,libcloud,oci,nlp]==0.14.1
composer[streaming,libcloud,oci,nlp]==0.15.0
mosaicml-cli==0.4.4
gradio==3.33.1
faiss-cpu==1.7.4
Expand Down
4 changes: 2 additions & 2 deletions examples/end-to-end-examples/sec_10k_qa/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
composer[nlp,streaming,wandb]==0.14.1
git+https://github.com/mosaicml/llm-foundry.git@main#egg=llm-foundry[gpu] # TODO: main
composer[nlp,streaming,wandb]==0.15.0
git+https://github.com/mosaicml/llm-foundry.git@v0.2.0#egg=llm-foundry[gpu] # TODO: main