ollama-multirun: refactor_this_bash_function___currently_it_makes_: 20250615-220523

models: qwen2.5-coder:7b codellama:7b starcoder:7b stable-code:3b deepcoder:1.5b dolphin3:8b gemma:2b granite3.3:2b mistral:7b qwen3:1.7b

Prompt: (raw) (yaml) words:143 bytes:1093

model words bytes total
duration
load
duration
prompt eval
count
prompt eval
duration
prompt eval
rate
eval
count
eval
duration
eval
rate
qwen2.5-coder:7b 175 1238 21.319922584s 19.986084ms 309 token(s) 2.901868083s 106.48 tokens/s 306 token(s) 18.397385542s 16.63 tokens/s
codellama:7b 265 1780 27.592548208s 19.398ms 336 token(s) 2.711845208s 123.90 tokens/s 464 token(s) 24.860334333s 18.66 tokens/s
starcoder:7b 0 5 2.102619083s 13.839583ms 319 token(s) 2.030820375s 157.08 tokens/s 2 token(s) 57.277667ms 34.92 tokens/s
stable-code:3b 141 1177 10.547121291s 14.478541ms 365 token(s) 1.58531575s 230.24 tokens/s 333 token(s) 8.946574167s 37.22 tokens/s
deepcoder:1.5b 4309 26649 2m18.403313084s 19.842292ms 283 token(s) 411.483834ms 687.75 tokens/s 5922 token(s) 2m17.971382333s 42.92 tokens/s
dolphin3:8b 120 918 16.30559675s 19.635916ms 303 token(s) 2.0743415s 146.07 tokens/s 243 token(s) 14.21076425s 17.10 tokens/s
gemma:2b 174 1060 6.541489792s 21.336125ms 321 token(s) 619.854542ms 517.86 tokens/s 276 token(s) 5.899745s 46.78 tokens/s
granite3.3:2b 146 1079 7.6524505s 15.909542ms 326 token(s) 936.218208ms 348.21 tokens/s 256 token(s) 6.699408667s 38.21 tokens/s
mistral:7b 151 1124 18.3125785s 14.693791ms 321 token(s) 2.087537875s 153.77 tokens/s 322 token(s) 16.209488791s 19.86 tokens/s
qwen3:1.7b 6 43


System
ollama proc100% GPU
ollama version0.9.0
sys archarm64
sys processorarm
sys memory14G + 795M
sys OSDarwin 24.5.0