Skip to content

Issues: b4rtaz/distributed-llama

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

28 Open 62 Closed
28 Open 62 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Inconsistent struct layouts can break cross-architecture usage
#190 opened Mar 22, 2025 by antoine-sac
In chat mode, the LLM agent seems to keep talking to itself without stopping.
#186 opened Mar 10, 2025 by Marvin-BW
Error when converting tokenizer from Mistral Large Instruct 2411: "Exception: Cannot resolve bosId or eosIds"
#185 opened Mar 9, 2025 by philigrale
8
Not able see Scaling performance with NuC (12th Gen) with deepseek_r1_distill_llama_8b_q40
#179 opened Mar 3, 2025 by deepaks2
7
Branching out on model support
#175 opened Feb 19, 2025 by pcfreak30
Weird bug where malformed API request causes model to analyze error message
#151 opened Jan 22, 2025 by jkeegan
2
Feature request: models endpoint support in dllama-api
#146 opened Dec 24, 2024 by jkeegan
Work with cline
#145 opened Dec 22, 2024 by piotreq7
1
Feature Request - Add Sliding Window Memory Scheduling
#128 opened Oct 5, 2024 by githuba9f5404
Tokenizer reported as incompatible tokenizer
#126 opened Sep 29, 2024 by elektroinformaciobiz
dllama-api & chat ui
#119 opened Aug 19, 2024 by twuerfl
Support for Gemma 2?
#115 opened Aug 4, 2024 by sdmorrey
2
[Feature request] Kubernetes setup
#101 opened Jul 12, 2024 by kami4ka
dllama: src/commands.cpp:102: MultiHeadAttSlice::MultiHeadAttSlice(unsigned int, unsigned int, unsigned int, slice_index_t): Assertion `nHeads % nSlices == 0' failed.
#98 opened Jul 7, 2024 by EntusiastaIApy
3
[New Feature] Add new route for dllama api for embeding models
#96 opened Jul 1, 2024 by testing0mon21
5
What about mobile phones?
#89 opened Jun 12, 2024 by dcale
6
support multi nvidia jetson agx orin?
#79 opened May 31, 2024 by WangFengtu1996
3
Support nSlices > nKvHeads
#70 opened May 27, 2024 by b4rtaz
1
Support for another models (ollama models)
#68 opened May 27, 2024 by testing0mon21
3
[Setup] Multiple Apple Silicon Macs: Questions
#67 opened May 26, 2024 by s04
1
network utilization
#58 opened May 18, 2024 by zhengpeirong
3
How To Add Suppoerted Model
#55 opened May 16, 2024 by hyperbolic-c
2
Vulkan Acceleration
#50 opened May 13, 2024 by DifferentialityDevelopment
35
Unknown header key's while converting llama 3 70b to distributed format
#40 opened May 8, 2024 by DifferentialityDevelopment
1
Will this awesome proj consider supporting GPU acceleration？
#35 opened Apr 29, 2024 by galenyu
5
ProTip! no:milestone will show everything without a milestone.