Dockerfile: fix build on ubuntu 24.04

- ppa:kisak/kisak does not exist (repo is kisak-mesa) and add-apt-repository
  failed outright; noble-updates already ships mesa 25.2.x with gfx1151 radv,
  so drop the PPA and use the distro mesa
- pin a modern shaderc/glslc (v2026.3) from conda-forge: noble's glslc
  (shaderc 2023.8) predates GL_NV_cooperative_matrix2 and the fork's
  coopmat2 vulkan kernels; the pinned stack is self-contained (rpath)
- add missing build deps this fork needs: pkg-config, spirv-headers
  (find_package(SPIRV-Headers) in ggml-vulkan), libssl-dev (httplib TLS),
  unzip/zstd for the glslc bundle
- copy all shared libs from bin/ (fork produces libmtmd, *-impl libs and
  backend .so's the old glob missed) + register /app via ld.so.conf
- drop LLAMA_CURL (deprecated no-op in this fork)
- CMD is now bare /app/llama-server so the image can be driven by an
  external runtime (llamaswap); host/port stay overridable via
  LLAMA_ARG_HOST/LLAMA_ARG_PORT env. compose passes the recommended flags

Verified by a clean-room build of the strix-halo-vulkan branch with
noble's toolchain + headers (gcc 13, vulkan-headers 1.3.275, openssl 3.0.13):
all three targets link and resolve against stock noble runtime libs,
llama-server/cli/bench boot successfully.
This commit is contained in:
2026-09-01 14:44:28 +00:00
parent eb6e00759c
commit 7f3096e86e
2 changed files with 61 additions and 26 deletions
+10 -4
View File
@@ -16,8 +16,14 @@ services:
- "8080:8080"
environment:
- LD_LIBRARY_PATH=/app
# override CMD to change context, quant, or add mtp:
# docker compose run qwen38-flash-next \
# /app/llama-server -m /models/Qwen3.8-Flash-Next-IQ4_XS-PLE.gguf \
# -c 131072 -md /models/mtp-Qwen3.8-Flash-Next-Q8_0.gguf \
# the image CMD is bare (/app/llama-server) — pass the model + flags:
command: >-
-m /models/Qwen3.8-Flash-Next-IQ4_XS-PLE.gguf
-ngl 999 -fa on -ctk q8_0 -ctv q8_0
-c 32768 -ub 2048 -t 4 --jinja
# for mtp speculative decoding:
# command: >-
# -m /models/Qwen3.8-Flash-Next-IQ4_XS-PLE.gguf
# -md /models/mtp-Qwen3.8-Flash-Next-Q8_0.gguf
# --spec-type draft-mtp --spec-draft-n-max 6 --spec-draft-p-min 0.75
# -ngl 999 -fa on -ctk q8_0 -ctv q8_0 -c 32768 -ub 2048 -t 4 --jinja