Discussions

• 1 You must be logged in to vote

  💬

  Loading Tokenizer from GGUF model

  yvonneprice started May 3, 2025 in General

  

  

  

  

  4
• 3 You must be logged in to vote

  💬

  ONNX Support: A proposal for Operator implementation

  imihalcea started Nov 21, 2024 in General

  

  

  

  

  2
• 1 You must be logged in to vote

  💡

  Support for faster-whisper

  jbousquie started Apr 20, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is it possible to use jina-embeddings-v2-base-en for embeddings?

  martin-conur asked Apr 17, 2025 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  examples/quantized-qwen2-instruct: text generation

  kotamine started Mar 31, 2025 in General

  

  

  4
• 2 You must be logged in to vote

  💬

  Learning Rate schedules (ReduceLROnPlateau, cosine) support

  kirillbobyrev started May 28, 2024 in General

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  Apple metal embedding generation panics w/ IOGPUMetalCommandBuffer failed assertion

  mateodelnorte started Mar 20, 2025 in General

  

  

  0
• 3 You must be logged in to vote

  💬

  Candle Discord?

  eisenzopf started Nov 27, 2024 in General

  

  

  

  

  12
• 1 You must be logged in to vote

  💡

  AWS Inferentia Support?

  MoonKraken started Feb 28, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💬

  Is memory mapping gguf model weights supported?

  finallyblueskies started Feb 27, 2025 in General

  

  

  0
• 7 You must be logged in to vote

  💬

  Future development of the project

  DimitriTimoz started Feb 22, 2025 in General

  

  

  1
• 2 You must be logged in to vote

  🙏

  Pytorch nn.transformer

  vishpat asked Feb 22, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  GPT-2 model

  vishpat started Feb 13, 2025 in General

  

  

  0
• 2 You must be logged in to vote

  🙏

  Modifying stable-diffusion demo for SDXL inpainting

  mneilly asked Jul 21, 2024 in Q&A · Unanswered

  

  

  

  

  5
• 2 You must be logged in to vote

  💡

  Add hip-kernel

  smedegaard started Jan 3, 2025 in Ideas

  

  

  1
• 0 You must be logged in to vote

  💬

  Could not find "Good first issue" for the the novice contributors.

  sreejithitvlb started Nov 8, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Why is Mamba-minimal able to train but not mamba?

  Corallus-Caninus asked Oct 20, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  advice & tips on indexing using multimodal embeddings 24h of screen recording on consumer hardware (100,000 frames/day)

  louis030195 started Oct 12, 2024 in Ideas

  

  

  

  

  6
• 2 You must be logged in to vote

  🙏

  Any plans in supporting JSON outputs for LLMs? Or example how to do so?

  louis030195 asked Oct 9, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Use of GPU on linux with AMD or Intel GPUs

  slangerosuna asked Sep 19, 2024 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  llama3.2 - Error: cannot find tensor lm_head.weight (HF/Candle Rust)

  louis030195 asked Sep 28, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  Would be nice to see this library in go

  ZanzyTHEbar started Sep 22, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Can I get some help with matching tensor shape?

  luxiant asked Sep 19, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to extract Labels & Scores from Raw Tensor Outputs(Text Classification Model)

  bajrangCoder asked Sep 18, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  Best practice for offline bulk batch inference in candle

  msminhas93 asked Feb 12, 2024 in Q&A · Closed · Unanswered

  

  

  

  

  3