Code

Upstream Accelerate#1741

Code

Draft

IlyasMoutawwakil wants to merge 45 commits intomainhuggingface/optimum-habana:mainfrom upstream-acceleratehuggingface/optimum-habana:upstream-accelerateCopy head branch name to clipboard

+461-366

Commits

Commits on Feb 4, 2025

• init

  IlyasMoutawwakil

  committed
  a66f9f5

  Copy full SHA for a66f9f5

• style

  IlyasMoutawwakil

  committed
  8058e80

  Copy full SHA for 8058e80

• change local accelerate name to avoid import issues

  IlyasMoutawwakil

  committed
  ee4b974

  Copy full SHA for ee4b974

• local FP8ContextWrapper

  IlyasMoutawwakil

  committed
  7abfff3

  Copy full SHA for 7abfff3

• local extract_model_from_parallel

  IlyasMoutawwakil

  committed
  6abfb7d

  Copy full SHA for 6abfb7d

• local accelerate

  IlyasMoutawwakil

  committed
  c49b0a2

  Copy full SHA for c49b0a2

• accelerator state

  IlyasMoutawwakil

  committed
  37ff6b0

  Copy full SHA for 37ff6b0

Commits on Feb 5, 2025

• fix simple trainer tests

  IlyasMoutawwakil

  committed
  246f836

  Copy full SHA for 246f836

• pass fast distributed tests

  IlyasMoutawwakil

  committed
  731d392

  Copy full SHA for 731d392

• deepspeed model parallel

  IlyasMoutawwakil

  committed
  88e12e0

  Copy full SHA for 88e12e0

• Merge branch 'main' into upstream-accelerate

  IlyasMoutawwakil

  authored
  4b58645

  Copy full SHA for 4b58645

Commits on Feb 6, 2025

• Merge branch 'main' into upstream-accelerate

  IlyasMoutawwakil

  committed
  a9a9a15

  Copy full SHA for a9a9a15

• merge

  IlyasMoutawwakil

  committed
  17b8291

  Copy full SHA for 17b8291

Commits on Feb 10, 2025

• test

  IlyasMoutawwakil

  committed
  b8fc49f

  Copy full SHA for b8fc49f

• pass fast distributed tests

  IlyasMoutawwakil

  committed
  a0f11d0

  Copy full SHA for a0f11d0

• test sloz

  IlyasMoutawwakil

  committed
  e1b32f8

  Copy full SHA for e1b32f8

• remove force_autocast

  IlyasMoutawwakil

  committed
  cd513b5

  Copy full SHA for cd513b5

Commits on Feb 11, 2025

• do fp8 conversion in trainer

  IlyasMoutawwakil

  committed
  abdc734

  Copy full SHA for abdc734

• fix

  IlyasMoutawwakil

  committed
  7f7dedc

  Copy full SHA for 7f7dedc

Commits on Feb 15, 2025

• test

  IlyasMoutawwakil

  committed
  a3951e5

  Copy full SHA for a3951e5

• Merge branch 'main' into upstream-accelerate

  IlyasMoutawwakil

  committed
  c32b701

  Copy full SHA for c32b701

Commits on Feb 18, 2025

• test

  IlyasMoutawwakil

  committed
  4240e55

  Copy full SHA for 4240e55

• cancel

  IlyasMoutawwakil

  committed
  c0eaa4b

  Copy full SHA for c0eaa4b

• fix

  IlyasMoutawwakil

  committed
  bfd23ea

  Copy full SHA for bfd23ea

• test

  IlyasMoutawwakil

  committed
  a8523c8

  Copy full SHA for a8523c8

• path

  IlyasMoutawwakil

  committed
  a30ab5f

  Copy full SHA for a30ab5f

• test

  IlyasMoutawwakil

  committed
  356d898

  Copy full SHA for 356d898

• use runner's HABANA_VISIBLE_DEVICES

  IlyasMoutawwakil

  committed
  b653727

  Copy full SHA for b653727

• don't use the same networks as host

  IlyasMoutawwakil

  committed
  beeeffa

  Copy full SHA for beeeffa

• remove

  IlyasMoutawwakil

  committed
  04fbe19

  Copy full SHA for 04fbe19

• sanitize

  IlyasMoutawwakil

  committed
  6f2fc7e

  Copy full SHA for 6f2fc7e

• now run accelerate

  IlyasMoutawwakil

  committed
  6a84721

  Copy full SHA for 6a84721

• exit after tests

  IlyasMoutawwakil

  committed
  145f062

  Copy full SHA for 145f062

• clean hf_home

  IlyasMoutawwakil

  committed
  98a1ab1

  Copy full SHA for 98a1ab1

• test

  IlyasMoutawwakil

  committed
  6ff0ddb

  Copy full SHA for 6ff0ddb

• shm

  IlyasMoutawwakil

  committed
  3ad3e51

  Copy full SHA for 3ad3e51

• HABANA_VISIBLE_MODULES

  IlyasMoutawwakil

  committed
  017f899

  Copy full SHA for 017f899

• fix

  IlyasMoutawwakil

  committed
  1e2d3f1

  Copy full SHA for 1e2d3f1

• abandon running accelerate tests in CI

  IlyasMoutawwakil

  committed
  e89782b

  Copy full SHA for e89782b

• test new DOCKER_HABANA_VISIBLE_DEVICES

  IlyasMoutawwakil

  committed
  e689bc4

  Copy full SHA for e689bc4

• fix

  IlyasMoutawwakil

  committed
  5ff3160

  Copy full SHA for 5ff3160

• Merge branch 'main' into upstream-accelerate

  IlyasMoutawwakil

  committed
  245fcda

  Copy full SHA for 245fcda

• fix

  IlyasMoutawwakil

  committed
  62c64fd

  Copy full SHA for 62c64fd

• test

  IlyasMoutawwakil

  committed
  ed6cc03

  Copy full SHA for ed6cc03

• ACCELERATE_BYPASS_DEVICE_MAP for now

  IlyasMoutawwakil

  committed
  50c783f

  Copy full SHA for 50c783f