Code

Ycros moe logging#6

Code

Open

kalomaze wants to merge 6 commits intokalomaze:exp-dynatemp-minp-latestkalomaze/koboldcpp:exp-dynatemp-minp-latestfrom ycros:ycros-moe-loggingycros/koboldcpp:ycros-moe-loggingCopy head branch name to clipboard

Commits

Commits on Dec 16, 2023

• Hacky poc of logging expert order.

  ycros

  committed
  5367090

  Copy full SHA for 5367090

• ggml-cuda: Replace bitonic argsort with insertion sort.

  ycros

  committed
  dae4ade

  Copy full SHA for dae4ade

• Count and print experts used per token.

  ycros

  committed
  7a05139

  Copy full SHA for 7a05139

• Kill ggml cpu debug prints.

  ycros

  committed
  31491d1

  Copy full SHA for 31491d1

Commits on Dec 17, 2023

• Merge branch 'concedo' into ycros/moe-logging

  ycros

  committed
  8832a05

  Copy full SHA for 8832a05

• Aggregate expert counters by prompt/gen. Print percentages as well.

  ycros

  committed
  8ee4c4d

  Copy full SHA for 8ee4c4d