server : add speculative decoding presets for FIM (#12287) #3
kallewoofbuild.yml
on: push
Matrix: ubuntu-cpu-cmake
Matrix: windows-2019-cmake-cuda
Matrix: windows-latest-cmake-hip-release
Matrix: windows-latest-cmake
macOS-latest-cmake-arm64
12m 22s
macOS-latest-cmake-x64
6m 25s
ubuntu-22-cmake-vulkan
41m 54s
windows-latest-cmake-sycl
14m 43s
ubuntu-latest-llguidance
4m 54s
ubuntu-latest-cmake-rpc
3m 8s
ubuntu-22-cmake-hip
22m 36s
ubuntu-22-cmake-musa
9m 55s
ubuntu-22-cmake-sycl
5m 57s
ubuntu-22-cmake-sycl-fp16
6m 17s
macOS-latest-cmake-ios
1m 35s
macOS-latest-cmake-tvos
1m 40s
ubuntu-latest-cmake-cuda
11m 38s
windows-latest-cmake-hip
29m 37s
ios-xcode-build
19m 19s
android-build
8m 0s
Matrix: macOS-latest-swift
Matrix: openEuler-latest-cmake-cann
Matrix: ubuntu-latest-cmake-sanitizer
Matrix: windows-msys2
release
1m 55s
Annotations
1 error and 49 warnings
|
windows-latest-cmake (avx512-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_...
Process completed with exit code 1.
|
|
macOS-latest-cmake-ios
Cache not found for keys: ccache-macOS-latest-cmake-ios-
|
|
macOS-latest-cmake-tvos
Cache not found for keys: ccache-macOS-latest-cmake-tvos-
|
|
ubuntu-cpu-cmake (x64, ubuntu-22.04)
Cache not found for keys: ccache-ubuntu-cpu-cmake-
|
|
ubuntu-latest-cmake-rpc
Cache not found for keys: ccache-ubuntu-latest-cmake-rpc-
|
|
windows-latest-cmake (llvm-arm64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=cmake/arm64-win...
Cache not found for keys: sccache-windows-latest-cmake-llvm-arm64-
|
|
windows-latest-cmake (msvc-arm64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=cmake/arm64-win...
Cache not found for keys: sccache-windows-latest-cmake-msvc-arm64-
|
|
ubuntu-latest-cmake-sanitizer (ADDRESS, Debug)
Cache not found for keys: ccache-ubuntu-latest-cmake-sanitizer-ADDRESS-
|
|
ubuntu-latest-cmake-sanitizer (UNDEFINED, Debug)
Cache not found for keys: ccache-ubuntu-latest-cmake-sanitizer-UNDEFINED-
|
|
windows-latest-cmake (noavx-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_A...
Saving cache failed: Error: Path Validation Error: Path(s) specified in the action for caching do(es) not exist, hence no cache is being saved.
|
|
windows-latest-cmake (noavx-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_A...
Cache not found for keys: sccache-windows-latest-cmake-noavx-x64-
|
|
windows-latest-cmake (openblas-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGM...
Saving cache failed: Error: Path Validation Error: Path(s) specified in the action for caching do(es) not exist, hence no cache is being saved.
|
|
windows-latest-cmake (openblas-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGM...
Cache not found for keys: sccache-windows-latest-cmake-openblas-x64-
|
|
windows-latest-cmake (llvm-arm64-opencl-adreno, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=c...
Cache not found for keys: sccache-windows-latest-cmake-llvm-arm64-opencl-adreno-
|
|
ubuntu-cpu-cmake (arm64, ubuntu-22.04-arm)
Cache not found for keys: ccache-ubuntu-cpu-cmake-
|
|
windows-latest-cmake (kompute-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML...
Cache not found for keys: sccache-windows-latest-cmake-kompute-x64-
|
|
windows-latest-cmake (kompute-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML...
Saving cache failed: Error: Path Validation Error: Path(s) specified in the action for caching do(es) not exist, hence no cache is being saved.
|
|
windows-msys2 (CLANG64, clang-x86_64, Release)
Cache not found for keys: sccache-windows-msys2-
|
|
windows-msys2 (CLANG64, clang-x86_64, Release)
Saving cache failed: Error: Path Validation Error: Path(s) specified in the action for caching do(es) not exist, hence no cache is being saved.
|
|
windows-latest-cmake (avx-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_AVX...
Saving cache failed: Error: Path Validation Error: Path(s) specified in the action for caching do(es) not exist, hence no cache is being saved.
|
|
windows-latest-cmake (avx-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_AVX...
Cache not found for keys: sccache-windows-latest-cmake-avx-x64-
|
|
windows-latest-cmake (avx2-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON)
Saving cache failed: Error: Path Validation Error: Path(s) specified in the action for caching do(es) not exist, hence no cache is being saved.
|
|
windows-latest-cmake (avx2-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON)
Cache not found for keys: sccache-windows-latest-cmake-avx2-x64-
|
|
ubuntu-22-cmake-sycl
Cache not found for keys: ccache-ubuntu-22-cmake-sycl-
|
|
windows-latest-cmake (avx512-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_...
Cache not found for keys: sccache-windows-latest-cmake-avx512-x64-
|
|
windows-latest-cmake (avx512-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_...
Saving cache failed: Error: Path Validation Error: Path(s) specified in the action for caching do(es) not exist, hence no cache is being saved.
|
|
ubuntu-22-cmake-sycl-fp16
Cache not found for keys: ccache-ubuntu-22-cmake-sycl-fp16-
|
|
macOS-latest-cmake-x64
Cache not found for keys: ccache-macOS-latest-cmake-x64-
|
|
windows-msys2 (UCRT64, ucrt-x86_64, Release)
Cache not found for keys: sccache-windows-msys2-
|
|
windows-msys2 (UCRT64, ucrt-x86_64, Release)
Saving cache failed: Error: Path Validation Error: Path(s) specified in the action for caching do(es) not exist, hence no cache is being saved.
|
|
windows-latest-cmake (vulkan-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_...
Saving cache failed: Error: Path Validation Error: Path(s) specified in the action for caching do(es) not exist, hence no cache is being saved.
|
|
windows-latest-cmake (vulkan-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_...
Cache not found for keys: sccache-windows-latest-cmake-vulkan-x64-
|
|
ubuntu-latest-cmake-sanitizer (THREAD, Debug)
Cache not found for keys: ccache-ubuntu-latest-cmake-sanitizer-THREAD-
|
|
android-build
Cache not found for keys: ccache-android-build-
|
|
ubuntu-22-cmake-musa
Cache not found for keys: ccache-ubuntu-22-cmake-musa-
|
|
ubuntu-latest-cmake-cuda
Cache not found for keys: ccache-ubuntu-latest-cmake-cuda-
|
|
macOS-latest-cmake-arm64
Cache not found for keys: ccache-macOS-latest-cmake-arm64-
|
|
macOS-latest-swift (generic/platform=tvOS)
Cache not found for keys: ccache-macOS-latest-swift-
|
|
windows-latest-cmake-sycl
Cache not found for keys: sccache-windows-latest-cmake-sycl-
|
|
macOS-latest-swift (generic/platform=macOS)
Cache not found for keys: ccache-macOS-latest-swift-
|
|
ubuntu-22-cmake-hip
Cache not found for keys: ccache-ubuntu-22-cmake-hip-
|
|
macOS-latest-swift (generic/platform=iOS)
Cache not found for keys: ccache-macOS-latest-swift-
|
|
windows-latest-cmake-hip-release (gfx1101)
Cache not found for keys: ccache-windows-latest-cmake-hip-release-
|
|
windows-latest-cmake-hip-release (gfx1030)
Cache not found for keys: ccache-windows-latest-cmake-hip-release-
|
|
windows-latest-cmake-hip
Cache not found for keys: ccache-windows-latest-cmake-hip-
|
|
windows-latest-cmake-hip-release (gfx1100)
Cache not found for keys: ccache-windows-latest-cmake-hip-release-
|
|
ubuntu-22-cmake-vulkan
Cache not found for keys: ccache-ubuntu-22-cmake-vulkan-
|
|
windows-2019-cmake-cuda (11.7, cuda)
Cache not found for keys: sccache-windows-2019-cmake-cuda-11.7-cuda-
|
|
windows-2019-cmake-cuda (12.4, cuda)
Cache not found for keys: sccache-windows-2019-cmake-cuda-12.4-cuda-
|
|
release
Cache not found for keys: ccache-release-
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
cudart-llama-bin-win-cu11.7-x64.zip
|
303 MB |
|
|
cudart-llama-bin-win-cu12.4-x64.zip
|
372 MB |
|
|
llama-b4858-xcframework
|
70.3 MB |
|
|
llama-bin-macos-arm64.zip
|
23.8 MB |
|
|
llama-bin-macos-x64.zip
|
25.5 MB |
|
|
llama-bin-ubuntu-arm64.zip
|
26 MB |
|
|
llama-bin-ubuntu-vulkan-x64.zip
|
31.7 MB |
|
|
llama-bin-ubuntu-x64.zip
|
27.6 MB |
|
|
llama-bin-win-avx-x64.zip
|
16.6 MB |
|
|
llama-bin-win-avx2-x64.zip
|
16.6 MB |
|
|
llama-bin-win-avx512-x64.zip
|
16.6 MB |
|
|
llama-bin-win-cu11.7-x64.zip
|
183 MB |
|
|
llama-bin-win-cu12.4-x64.zip
|
182 MB |
|
|
llama-bin-win-hip-x64-gfx1030.zip
|
241 MB |
|
|
llama-bin-win-hip-x64-gfx1100.zip
|
244 MB |
|
|
llama-bin-win-hip-x64-gfx1101.zip
|
244 MB |
|
|
llama-bin-win-kompute-x64.zip
|
16.9 MB |
|
|
llama-bin-win-llvm-arm64-opencl-adreno.zip
|
21.5 MB |
|
|
llama-bin-win-llvm-arm64.zip
|
21.5 MB |
|
|
llama-bin-win-msvc-arm64.zip
|
61.1 MB |
|
|
llama-bin-win-noavx-x64.zip
|
16.6 MB |
|
|
llama-bin-win-openblas-x64.zip
|
27.6 MB |
|
|
llama-bin-win-sycl-x64.zip
|
98.9 MB |
|
|
llama-bin-win-vulkan-x64.zip
|
21.6 MB |
|