ollama-multirun: swdub3jligfsbcbwcmv2aw91cybpbnn0cnvjdglvbnmucklnbm: 20250703-153147

models: bakllava:7b codellama:7b deepcoder:1.5b deepseek-r1:1.5b deepseek-r1:8b dolphin-mistral:7b dolphin3:8b gemma3:1b gemma3:4b gemma:2b granite3.2-vision:2b granite3.3:2b huihui_ai/baronllm-abliterated:8b llama3-groq-tool-use:8b llama3.2:1b llava-llama3:8b llava-phi3:3.8b llava:7b minicpm-v:8b mistral:7b qwen2.5-coder:7b qwen2.5vl:3b qwen2.5vl:7b qwen3:1.7b qwen3:8b stable-code:3b starcoder:7b

Prompt: (raw) (yaml) words:1 bytes:229

model words bytes total
duration		 load
duration		 prompt eval
count		 prompt eval
duration		 prompt eval
rate		 eval
count		 eval
duration		 eval
rate
bakllava:7b 1 3 1.87889s 10.29075ms 181 token(s) 1.815248459s 99.71 tokens/s 2 token(s) 52.705208ms 37.95 tokens/s
codellama:7b 128 711 11.854476583s 11.867458ms 195 token(s) 2.747244s 70.98 tokens/s 169 token(s) 9.09354325s 18.58 tokens/s
deepcoder:1.5b 4 311 1.39900775s 26.043917ms 160 token(s) 268.55175ms 595.79 tokens/s 62 token(s) 1.103836958s 56.17 tokens/s
deepseek-r1:1.5b 165 979 2m5.24810075s 25.76125ms 160 token(s) 257.953417ms 620.27 tokens/s 5485 token(s) 2m4.963727833s 43.89 tokens/s
deepseek-r1:8b 6 43
dolphin-mistral:7b 58 878 25.448114083s 8.582625ms 197 token(s) 1.644988s 119.76 tokens/s 465 token(s) 23.79385225s 19.54 tokens/s
dolphin3:8b 23 131 3.974468375s 33.406417ms 177 token(s) 2.475364833s 71.50 tokens/s 27 token(s) 1.465024792s 18.43 tokens/s
gemma3:1b 288 1891 6.767517875s 52.532083ms 151 token(s) 174.512ms 865.27 tokens/s 436 token(s) 6.539870708s 66.67 tokens/s
gemma3:4b 138 765 9.013866959s 51.126792ms 151 token(s) 585.6545ms 257.83 tokens/s 242 token(s) 8.376486667s 28.89 tokens/s
gemma:2b 22 112 843.073625ms 29.558167ms 160 token(s) 313.949958ms 509.64 tokens/s 25 token(s) 499.011584ms 50.10 tokens/s
granite3.2-vision:2b 51 285 2.880863417s 18.665459ms 183 token(s) 1.429462084s 128.02 tokens/s 61 token(s) 1.432047666s 42.60 tokens/s
granite3.3:2b 117 880 4.624963583s 20.307417ms 179 token(s) 527.214375ms 339.52 tokens/s 163 token(s) 4.076627333s 39.98 tokens/s
huihui_ai/baronllm-abliterated:8b 72 415 6.066471625s 31.108625ms 164 token(s) 1.388002958s 118.16 tokens/s 84 token(s) 4.646813583s 18.08 tokens/s
llama3-groq-tool-use:8b 24 137 3.6975925s 29.421959ms 164 token(s) 2.24262425s 73.13 tokens/s 28 token(s) 1.424920375s 19.65 tokens/s
llama3.2:1b 109 733 3.503749042s 30.238125ms 179 token(s) 246.77ms 725.37 tokens/s 182 token(s) 3.226138958s 56.41 tokens/s
llava-llama3:8b 48 270 5.605654792s 30.366042ms 164 token(s) 2.44646025s 67.04 tokens/s 55 token(s) 3.128193334s 17.58 tokens/s
llava-phi3:3.8b 15 80 1.687184625s 16.09ms 185 token(s) 960.356208ms 192.64 tokens/s 22 token(s) 709.516208ms 31.01 tokens/s
llava:7b 75 456 5.862617125s 11.714292ms 177 token(s) 1.190781084s 148.64 tokens/s 93 token(s) 4.659511s 19.96 tokens/s
minicpm-v:8b 60 551 13.468427791s 24.164458ms 165 token(s) 2.550022s 64.71 tokens/s 221 token(s) 10.893590709s 20.29 tokens/s
mistral:7b 29 180 3.522766291s 15.235041ms 174 token(s) 1.348473042s 129.03 tokens/s 45 token(s) 2.158197708s 20.85 tokens/s
qwen2.5-coder:7b 80 456 6.641804916s 28.582333ms 186 token(s) 1.281052875s 145.19 tokens/s 100 token(s) 5.331553792s 18.76 tokens/s
qwen2.5vl:3b 52 294 2.594589s 28.350125ms 177 token(s) 775.226125ms 228.32 tokens/s 64 token(s) 1.790509417s 35.74 tokens/s
qwen2.5vl:7b 95 764 17.431329666s 29.847208ms 177 token(s) 3.116813125s 56.79 tokens/s 268 token(s) 14.2840665s 18.76 tokens/s
qwen3:1.7b 6 43
qwen3:8b 112 648 2m33.33756625s 25.786291ms 167 token(s) 3.575571792s 46.71 tokens/s 2171 token(s) 2m29.735625791s 14.50 tokens/s
stable-code:3b 89 563 3.063369875s 15.887334ms 165 token(s) 668.37575ms 246.87 tokens/s 103 token(s) 2.37822375s 43.31 tokens/s
starcoder:7b 90 542 7.199775s 20.283625ms 136 token(s) 992.945334ms 136.97 tokens/s 118 token(s) 6.185847083s 19.08 tokens/s


System
ollama proc100% GPU
ollama version0.9.3
sys archarm64
sys processorarm
sys memory15G + 2836M
sys OSDarwin 24.5.0