Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/disable log gradients #131

Merged
merged 4 commits into from
Jan 16, 2025
Merged

Feat/disable log gradients #131

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
69e0c1b
refactor: Disable logging gradients in default callbacks
lorenzomammana Jan 16, 2025
abab4e4
build: Upgrade version, update changelog
lorenzomammana Jan 16, 2025
93e6b94
refactor: Remove gradient logging from default callback, add automati…
lorenzomammana Jan 16, 2025
6454a5e
docs: Update changelog
lorenzomammana Jan 16, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,13 @@
# Changelog
All notable changes to this project will be documented in this file.

### [2.2.6]

#### Updated

- Remove gradients logging callback from default configs to avoid slowing down the training process
- Add automatic batch size calculator as default in `all` callback configuration

### [2.2.5]

#### Updated
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[tool.poetry]
name = "quadra"
version = "2.2.5"
version = "2.2.6"
description = "Deep Learning experiment orchestration library"
authors = [
"Federico Belotti <[email protected]>",
Expand Down
2 changes: 1 addition & 1 deletion quadra/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
__version__ = "2.2.5"
__version__ = "2.2.6"


def get_version():
Expand Down
13 changes: 13 additions & 0 deletions quadra/configs/callbacks/all.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,3 +30,16 @@ progress_bar:
lightning_trainer_setup:
_target_: quadra.callbacks.lightning.LightningTrainerBaseSetup
log_every_n_steps: 1

batch_size_finder:
_target_: quadra.callbacks.lightning.BatchSizeFinder
mode: power
steps_per_trial: 3
init_val: 2
max_trials: 5 # Max 64
batch_arg_name: batch_size
disable: false
find_train_batch_size: true
find_validation_batch_size: false
find_test_batch_size: false
find_predict_batch_size: false
3 changes: 0 additions & 3 deletions quadra/configs/callbacks/default.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,9 +9,6 @@ model_checkpoint:
filename: "epoch_{epoch:03d}"
auto_insert_metric_name: False

log_gradients:
_target_: quadra.callbacks.mlflow.LogGradients
norm: 2
lr_monitor:
_target_: pytorch_lightning.callbacks.LearningRateMonitor
logging_interval: "epoch"
Expand Down
3 changes: 0 additions & 3 deletions quadra/configs/callbacks/default_anomalib.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,9 +44,6 @@ upload_ckpts_as_artifact:
upload_best_only: true
delete_after_upload: true
upload: false
log_gradients:
_target_: quadra.callbacks.mlflow.LogGradients
norm: 2
lr_monitor:
_target_: pytorch_lightning.callbacks.LearningRateMonitor
logging_interval: "epoch"
Expand Down
Loading