All MicroEvals
Qwen3.8 Ik_llama
Create MicroEval
Header image for Qwen3.8 Ik_llama

Qwen3.8 Ik_llama

Prompt

this is on ubergarms qwen quant: git clone [https://github.com/ikawrakow/ik_llama.cpp.git](https://github.com/ikawrakow/ik_llama.cpp.git) cd ik_llama.cpp cmake -B build -DCMAKE_BUILD_TYPE=Release -DGGML_CUDA=ON -DGGML_CUDA_F16=ON cmake --build build --config Release -j $(nproc) # wget [https://huggingface.co/ubergarm/Qwen3.8-27B-GGUF/resolve/main/Qwen3.8-27B-MTP-IQ4_KS.gguf](https://huggingface.co/ubergarm/Qwen3.8-27B-GGUF/resolve/main/Qwen3.8-27B-MTP-IQ4_KS.gguf) model=/mnt/ai/models/ubergarm/Qwen3.8-27B-GGUF/Qwen3.8-27B-MTP-IQ4_KS.gguf # wget wget [https://huggingface.co/ggml-org/Qwen3.8-27B-GGUF/resolve/main/mmproj-Qwen3.8-27B-Q8_0.gguf](https://huggingface.co/ggml-org/Qwen3.8-27B-GGUF/resolve/main/mmproj-Qwen3.8-27B-Q8_0.gguf) mmproj=/mnt/ai/models/ubergarm/Qwen3.8-27B-GGUF/mmproj-Qwen3.8-27B-Q8_0.gguf CUDA_VISIBLE_DEVICES="0" \ ./build/bin/llama-server \ --model "$model" \ --alias "Qwen3.8-27B" \ -c 131072 \ -ctk q8_0 -ctv q8_0 \ -ctkd q8_0 -ctvd q8_0 \ --merge-qkv \ -muge \ -ngl 99 \ -t 1 \ -tb 1 \ -tm 16 \ --host 127.0.0.1 \ --port 8080 \ --parallel 1 \ --jinja \ --ctx-checkpoints 32 \ -cram 32768 \ --spec-type mtp:n_max=4,p_min=0.0 \ --no-mmproj-offload \ --mmproj "$mmproj" \ can you see if anything is missing here, check ik_llama github discussions commits etc if there is anything else missing and command line params in general that you would suggest me 3090rtx 5800x win11

Drag to resize
Drag to resize
Drag to resize
Drag to resize