Code

Tensor Parallel support#2354

Code

Open

bursteratom wants to merge 10 commits intomainaxolotl-ai-cloud/axolotl:mainfrom tp_supportaxolotl-ai-cloud/axolotl:tp_supportCopy head branch name to clipboard

+19

Commits

Commits on Feb 26, 2025

• enabe tp thru tp_size

  bursteratom

  committed
  dbdf97e

  Copy full SHA for dbdf97e

• set tp_plan

  bursteratom

  committed
  dbd43aa

  Copy full SHA for dbd43aa

• del device_map for tp

  bursteratom

  committed
  d663652

  Copy full SHA for d663652

• skip move to device

  bursteratom

  committed
  a74efce

  Copy full SHA for a74efce

• prepare accelerate envs for tp

  bursteratom

  committed
  438b623

  Copy full SHA for 438b623

• tp plan not needed

  bursteratom

  committed
  64adbf1

  Copy full SHA for 64adbf1

• add tp_size in config doc

  bursteratom

  committed
  984be14

  Copy full SHA for 984be14

• auto detect tp_size

  bursteratom

  committed
  4caa59a

  Copy full SHA for 4caa59a

• nit

  bursteratom

  committed
  3dd5c6f

  Copy full SHA for 3dd5c6f

• Update __init__.py

  bursteratom

  committed
  f68aedd

  Copy full SHA for f68aedd