ollama-multirun: refactor_this_bash_function___currently_it_makes_: 20250614-132534

models: qwen2.5-coder:7b codellama:7b starcoder:7b stable-code:3b deepcoder:1.5b dolphin3:8b gemma:2b granite3.3:2b mistral:7b qwen3:1.7b

Prompt: (raw) (yaml) words:143 bytes:1093

model words bytes total
duration
load
duration
prompt eval
count
prompt eval
duration
prompt eval
rate
eval
count
eval
duration
eval
rate
qwen2.5-coder:7b 176 1355 21.0618275s 17.523875ms 309 token(s) 2.128589208s 145.17 tokens/s 333 token(s) 18.915040709s 17.61 tokens/s
codellama:7b 123 891 16.098172167s 12.354584ms 336 token(s) 2.424721084s 138.57 tokens/s 263 token(s) 13.660186916s 19.25 tokens/s
starcoder:7b 69 647 14.7156465s 13.070709ms 319 token(s) 2.017135666s 158.15 tokens/s 224 token(s) 12.684782125s 17.66 tokens/s
stable-code:3b 133 1012 9.35481075s 10.891875ms 365 token(s) 1.450132083s 251.70 tokens/s 299 token(s) 7.893164584s 37.88 tokens/s
deepcoder:1.5b 4497 28816 2m27.492376667s 19.729333ms 283 token(s) 477.227542ms 593.01 tokens/s 6146 token(s) 2m26.994775583s 41.81 tokens/s
dolphin3:8b 87 739 14.605707125s 16.04ms 303 token(s) 2.162709084s 140.10 tokens/s 199 token(s) 12.426358583s 16.01 tokens/s
gemma:2b 130 966 6.552518792s 20.451917ms 321 token(s) 650.661167ms 493.34 tokens/s 258 token(s) 5.880852083s 43.87 tokens/s
granite3.3:2b 112 898 7.155068625s 14.689708ms 326 token(s) 976.61575ms 333.81 tokens/s 228 token(s) 6.162484166s 37.00 tokens/s
mistral:7b 171 1238 20.808285333s 11.120625ms 321 token(s) 2.146399917s 149.55 tokens/s 347 token(s) 18.650058625s 18.61 tokens/s
qwen3:1.7b 2766 17261 1m59.683683833s 19.611833ms 290 token(s) 553.142ms 524.28 tokens/s 4514 token(s) 1m59.110299625s 37.90 tokens/s


System
ollama proc100% GPU
ollama version0.9.0
sys archarm64
sys processorarm
sys memory12G + 646M
sys OSDarwin 24.5.0