ollama-multirun: help_me_write_a_javascript_function_to_parse_data_: 20250703-124618

models: bakllava:7b codellama:7b deepcoder:1.5b deepseek-r1:1.5b deepseek-r1:8b dolphin-mistral:7b dolphin3:8b gemma3:1b gemma3:4b gemma:2b granite3.2-vision:2b granite3.3:2b huihui_ai/baronllm-abliterated:8b llama3-groq-tool-use:8b llama3.2:1b llava-llama3:8b llava-phi3:3.8b llava:7b minicpm-v:8b mistral:7b qwen2.5-coder:7b qwen2.5vl:3b qwen2.5vl:7b qwen3:1.7b qwen3:8b stable-code:3b starcoder:7b

Prompt: (raw) (yaml) words:176 bytes:1510

model words bytes total
duration
load
duration
prompt eval
count
prompt eval
duration
prompt eval
rate
eval
count
eval
duration
eval
rate
bakllava:7b 18 95 4.455241292s 16.018375ms 400 token(s) 3.116686042s 128.34 tokens/s 24 token(s) 1.321719916s 18.16 tokens/s
codellama:7b 148 1373 26.686043959s 11.229167ms 403 token(s) 3.833408417s 105.13 tokens/s 417 token(s) 22.840758333s 18.26 tokens/s
deepcoder:1.5b 378 3333 3m18.091709834s 26.826042ms 339 token(s) 509.6065ms 665.22 tokens/s 7858 token(s) 3m17.554778875s 39.78 tokens/s
deepseek-r1:1.5b 287 2641 30.290493792s 28.461459ms 339 token(s) 517.283917ms 655.35 tokens/s 1492 token(s) 29.74401275s 50.16 tokens/s
deepseek-r1:8b 6 43
dolphin-mistral:7b 236 2324 33.654590167s 12.508083ms 416 token(s) 2.888921208s 144.00 tokens/s 583 token(s) 30.752454583s 18.96 tokens/s
dolphin3:8b 343 3026 40.301222708s 29.862291ms 344 token(s) 3.417363125s 100.66 tokens/s 623 token(s) 36.853326417s 16.90 tokens/s
gemma3:1b 504 4142 16.254697666s 51.696333ms 369 token(s) 331.351375ms 1113.62 tokens/s 1022 token(s) 15.8710475s 64.39 tokens/s
gemma3:4b 488 4071 36.762559042s 58.916167ms 369 token(s) 1.440075375s 256.24 tokens/s 971 token(s) 35.262888375s 27.54 tokens/s
gemma:2b 155 1137 7.906618792s 29.484958ms 383 token(s) 659.926208ms 580.37 tokens/s 333 token(s) 7.216524917s 46.14 tokens/s
granite3.2-vision:2b 174 1443 11.458531417s 16.298958ms 378 token(s) 2.012187584s 187.86 tokens/s 357 token(s) 9.428643125s 37.86 tokens/s
granite3.3:2b 250 2484 17.466471916s 20.360208ms 374 token(s) 980.814458ms 381.32 tokens/s 596 token(s) 16.464499792s 36.20 tokens/s
huihui_ai/baronllm-abliterated:8b 255 2425 33.252506958s 30.936625ms 331 token(s) 2.3323975s 141.91 tokens/s 531 token(s) 30.88852s 17.19 tokens/s
llama3-groq-tool-use:8b 199 1976 28.084724458s 31.672916ms 331 token(s) 2.636971333s 125.52 tokens/s 461 token(s) 25.414796s 18.14 tokens/s
llama3.2:1b 259 2269 10.204498s 30.595333ms 346 token(s) 430.363541ms 803.97 tokens/s 506 token(s) 9.742847834s 51.94 tokens/s
llava-llama3:8b 141 1165 20.044483042s 32.646458ms 349 token(s) 3.494024583s 99.88 tokens/s 285 token(s) 16.517203208s 17.25 tokens/s
llava-phi3:3.8b 254 2115 21.507396375s 16.044709ms 393 token(s) 1.808091958s 217.36 tokens/s 561 token(s) 19.682436875s 28.50 tokens/s
llava:7b 361 3197 51.280398291s 14.933375ms 396 token(s) 2.994029542s 132.26 tokens/s 896 token(s) 48.270663375s 18.56 tokens/s
minicpm-v:8b 292 2746 37.609025042s 22.611875ms 344 token(s) 2.843545958s 120.98 tokens/s 660 token(s) 34.742225042s 19.00 tokens/s
mistral:7b 314 3324 44.417155125s 11.022333ms 393 token(s) 2.843851458s 138.19 tokens/s 777 token(s) 41.561598625s 18.70 tokens/s
qwen2.5-coder:7b 395 4024 52.490335875s 28.202583ms 365 token(s) 3.256319791s 112.09 tokens/s 868 token(s) 49.20527225s 17.64 tokens/s
qwen2.5vl:3b 343 2823 18.9001605s 33.838625ms 359 token(s) 1.212089792s 296.18 tokens/s 607 token(s) 17.65364825s 34.38 tokens/s
qwen2.5vl:7b 424 3672 48.192025208s 27.186792ms 359 token(s) 4.229740167s 84.88 tokens/s 785 token(s) 43.93446075s 17.87 tokens/s
qwen3:1.7b 6 43
qwen3:8b 6 43
stable-code:3b 1611 15794 2m30.640837s 27.450459ms 370 token(s) 1.48914325s 248.47 tokens/s 3790 token(s) 2m29.1235375s 25.42 tokens/s
starcoder:7b 0 3 2.160816625s 18.622083ms 341 token(s) 2.08676s 163.41 tokens/s 2 token(s) 54.53ms 36.68 tokens/s


System
ollama proc100% GPU
ollama version0.9.3
sys archarm64
sys processorarm
sys memory15G + 2249M
sys OSDarwin 24.5.0