Code

Fix training#774

Code

Merged

michaelbenayoun merged 37 commits intomainhuggingface/optimum-neuron:mainfrom align_for_traininghuggingface/optimum-neuron:align_for_trainingCopy head branch name to clipboardFeb 26, 2025

+560-444

Commits

Commits on Feb 11, 2025

• WIP fix training loss

  michaelbenayoun

  committed
  4284963

  Copy full SHA for 4284963

• WIP fix training loss

  michaelbenayoun

  committed
  38ef8f1

  Copy full SHA for 38ef8f1

• Small fix on prepare_dataloder

  michaelbenayoun

  committed
  0b7f6d5

  Copy full SHA for 0b7f6d5

• Fix grad norm

  michaelbenayoun

  committed
  39ab969

  Copy full SHA for 39ab969

• Fix training loop

  michaelbenayoun

  committed
  a7f7695

  Copy full SHA for a7f7695

• Temporary change of this file to debug thing

  michaelbenayoun

  committed
  b67f265

  Copy full SHA for b67f265

• Fix mixed precision

  michaelbenayoun

  committed
  fe231bf

  Copy full SHA for fe231bf

• Restore script for tutorial

  michaelbenayoun

  committed
  26baa0f

  Copy full SHA for 26baa0f

• Fix style

  michaelbenayoun

  committed
  a1412e2

  Copy full SHA for a1412e2

• Fix style

  michaelbenayoun

  committed
  39e54e1

  Copy full SHA for 39e54e1

Commits on Feb 12, 2025

• Fix dtype casting issue with TP

  michaelbenayoun

  committed
  0639f91

  Copy full SHA for 0639f91

Commits on Feb 19, 2025

• [WIP]

  michaelbenayoun

  committed
  e1b2591

  Copy full SHA for e1b2591

Commits on Feb 20, 2025

• [WIP]

  michaelbenayoun

  committed
  3da78b4

  Copy full SHA for 3da78b4

• [WIP]

  michaelbenayoun

  committed
  11375d7

  Copy full SHA for 11375d7

• Remove LinearWithAsyncCommunicationFixed

  michaelbenayoun

  committed
  48f0116

  Copy full SHA for 48f0116

• Add docstring for parallel_cross_entropy

  michaelbenayoun

  committed
  d97c835

  Copy full SHA for d97c835

• Cleanup

  michaelbenayoun

  committed
  56fd4c3

  Copy full SHA for 56fd4c3

Commits on Feb 21, 2025

• Remove empty spaces

  michaelbenayoun

  committed
  1b4080b

  Copy full SHA for 1b4080b

• Merge branch 'main' into align_for_training

  michaelbenayoun

  committed
  fc34abc

  Copy full SHA for fc34abc

• Remove SDK 2.20 specifics

  michaelbenayoun

  committed
  e3623a0

  Copy full SHA for e3623a0

• Styling

  michaelbenayoun

  committed
  3aaa023

  Copy full SHA for 3aaa023

• Fixes

  michaelbenayoun

  committed
  1807f71

  Copy full SHA for 1807f71

• Remove unused comment

  michaelbenayoun

  committed
  2c2a101

  Copy full SHA for 2c2a101

• Fix

  michaelbenayoun

  committed
  a59744d

  Copy full SHA for a59744d

Commits on Feb 24, 2025

• Fix

  michaelbenayoun

  committed
  ccb6960

  Copy full SHA for ccb6960

• [WIP] fix GQA QKV

  michaelbenayoun

  committed
  3a5a168

  Copy full SHA for 3a5a168

• [WIP] GQA checkpointing works, but output_proj does not work

  michaelbenayoun

  committed
  8704584

  Copy full SHA for 8704584

• Fix output_proj

  michaelbenayoun

  committed
  d29ed89

  Copy full SHA for d29ed89

• Fix

  michaelbenayoun

  committed
  08d58f8

  Copy full SHA for 08d58f8

• Fix

  michaelbenayoun

  committed
  e885d08

  Copy full SHA for e885d08

• Styling

  michaelbenayoun

  committed
  3ee8bda

  Copy full SHA for 3ee8bda

Commits on Feb 26, 2025

• Fix loss zeroing

  michaelbenayoun

  committed
  031acce

  Copy full SHA for 031acce

• Fix test

  michaelbenayoun

  committed
  1d83221

  Copy full SHA for 1d83221

• Styling

  michaelbenayoun

  committed
  701360b

  Copy full SHA for 701360b

• Fix teardown

  michaelbenayoun

  committed
  412e16f

  Copy full SHA for 412e16f

• Styling

  michaelbenayoun

  committed
  b920479

  Copy full SHA for b920479

• Apply suggestions

  michaelbenayoun

  committed
  2be6cbc

  Copy full SHA for 2be6cbc