Code

Gargamit/fix long seq bug#6

Code

Draft

garg-amit wants to merge 16 commits intomaingarg-amit/vllm:mainfrom

gargamit/fix-long-seq-buggarg-amit/vllm:gargamit/fix-long-seq-bugCopy head branch name to clipboard

Commits

Commits on Sep 3, 2024

• fixed long seq bug for mini

  garg-amit

  committed
  3732971

  Copy full SHA for 3732971

• Created separate modeling file for phi3

  garg-amit

  committed
  801c8dd

  Copy full SHA for 801c8dd

• format

  garg-amit

  committed
  dd9e661

  Copy full SHA for dd9e661

• fix flashinfer attention backend

  garg-amit

  committed
  910ce8c

  Copy full SHA for 910ce8c

• ix blocksparse attn backend and phi3-small models

  garg-amit

  committed
  49b0674

  Copy full SHA for 49b0674

• format

  garg-amit

  committed
  836818f

  Copy full SHA for 836818f

• fixed phi3 import

  garg-amit

  committed
  ba471c2

  Copy full SHA for ba471c2

• fixed type

  garg-amit

  committed
  e383a9a

  Copy full SHA for e383a9a

• fixed cpu backend

  garg-amit

  committed
  a87b84f

  Copy full SHA for a87b84f

• fixed rocm backend

  garg-amit

  committed
  55b220d

  Copy full SHA for 55b220d

• format

  garg-amit

  committed
  c400a81

  Copy full SHA for c400a81

• tpu and xpu fix

  garg-amit

  committed
  ed641fb

  Copy full SHA for ed641fb

• format

  garg-amit

  committed
  629c826

  Copy full SHA for 629c826

• Phi MoE LongRoPE fix

  garg-amit

  committed
  893f5b0

  Copy full SHA for 893f5b0

Commits on Sep 5, 2024

• fixed rotary embedding

  garg-amit

  committed
  d474164

  Copy full SHA for d474164

• Merge pull request #7 from garg-amit/moe-longrope-fix

  Show description for 64df8b8
  garg-amit

  authored
  64df8b8

  Copy full SHA for 64df8b8