Prompt: (raw) (yaml)
words:176 bytes:1510
model | words | bytes | total duration |
load duration |
prompt eval count |
prompt eval duration |
prompt eval rate |
eval count |
eval duration |
eval rate |
---|---|---|---|---|---|---|---|---|---|---|
bakllava:7b | 18 | 95 | 4.455241292s | 16.018375ms | 400 token(s) | 3.116686042s | 128.34 tokens/s | 24 token(s) | 1.321719916s | 18.16 tokens/s |
codellama:7b | 148 | 1373 | 26.686043959s | 11.229167ms | 403 token(s) | 3.833408417s | 105.13 tokens/s | 417 token(s) | 22.840758333s | 18.26 tokens/s |
deepcoder:1.5b | 378 | 3333 | 3m18.091709834s | 26.826042ms | 339 token(s) | 509.6065ms | 665.22 tokens/s | 7858 token(s) | 3m17.554778875s | 39.78 tokens/s |
deepseek-r1:1.5b | 287 | 2641 | 30.290493792s | 28.461459ms | 339 token(s) | 517.283917ms | 655.35 tokens/s | 1492 token(s) | 29.74401275s | 50.16 tokens/s |
deepseek-r1:8b | 6 | 43 | ||||||||
dolphin-mistral:7b | 236 | 2324 | 33.654590167s | 12.508083ms | 416 token(s) | 2.888921208s | 144.00 tokens/s | 583 token(s) | 30.752454583s | 18.96 tokens/s |
dolphin3:8b | 343 | 3026 | 40.301222708s | 29.862291ms | 344 token(s) | 3.417363125s | 100.66 tokens/s | 623 token(s) | 36.853326417s | 16.90 tokens/s |
gemma3:1b | 504 | 4142 | 16.254697666s | 51.696333ms | 369 token(s) | 331.351375ms | 1113.62 tokens/s | 1022 token(s) | 15.8710475s | 64.39 tokens/s |
gemma3:4b | 488 | 4071 | 36.762559042s | 58.916167ms | 369 token(s) | 1.440075375s | 256.24 tokens/s | 971 token(s) | 35.262888375s | 27.54 tokens/s |
gemma:2b | 155 | 1137 | 7.906618792s | 29.484958ms | 383 token(s) | 659.926208ms | 580.37 tokens/s | 333 token(s) | 7.216524917s | 46.14 tokens/s |
granite3.2-vision:2b | 174 | 1443 | 11.458531417s | 16.298958ms | 378 token(s) | 2.012187584s | 187.86 tokens/s | 357 token(s) | 9.428643125s | 37.86 tokens/s |
granite3.3:2b | 250 | 2484 | 17.466471916s | 20.360208ms | 374 token(s) | 980.814458ms | 381.32 tokens/s | 596 token(s) | 16.464499792s | 36.20 tokens/s |
huihui_ai/baronllm-abliterated:8b | 255 | 2425 | 33.252506958s | 30.936625ms | 331 token(s) | 2.3323975s | 141.91 tokens/s | 531 token(s) | 30.88852s | 17.19 tokens/s |
llama3-groq-tool-use:8b | 199 | 1976 | 28.084724458s | 31.672916ms | 331 token(s) | 2.636971333s | 125.52 tokens/s | 461 token(s) | 25.414796s | 18.14 tokens/s |
llama3.2:1b | 259 | 2269 | 10.204498s | 30.595333ms | 346 token(s) | 430.363541ms | 803.97 tokens/s | 506 token(s) | 9.742847834s | 51.94 tokens/s |
llava-llama3:8b | 141 | 1165 | 20.044483042s | 32.646458ms | 349 token(s) | 3.494024583s | 99.88 tokens/s | 285 token(s) | 16.517203208s | 17.25 tokens/s |
llava-phi3:3.8b | 254 | 2115 | 21.507396375s | 16.044709ms | 393 token(s) | 1.808091958s | 217.36 tokens/s | 561 token(s) | 19.682436875s | 28.50 tokens/s |
llava:7b | 361 | 3197 | 51.280398291s | 14.933375ms | 396 token(s) | 2.994029542s | 132.26 tokens/s | 896 token(s) | 48.270663375s | 18.56 tokens/s |
minicpm-v:8b | 292 | 2746 | 37.609025042s | 22.611875ms | 344 token(s) | 2.843545958s | 120.98 tokens/s | 660 token(s) | 34.742225042s | 19.00 tokens/s |
mistral:7b | 314 | 3324 | 44.417155125s | 11.022333ms | 393 token(s) | 2.843851458s | 138.19 tokens/s | 777 token(s) | 41.561598625s | 18.70 tokens/s |
qwen2.5-coder:7b | 395 | 4024 | 52.490335875s | 28.202583ms | 365 token(s) | 3.256319791s | 112.09 tokens/s | 868 token(s) | 49.20527225s | 17.64 tokens/s |
qwen2.5vl:3b | 343 | 2823 | 18.9001605s | 33.838625ms | 359 token(s) | 1.212089792s | 296.18 tokens/s | 607 token(s) | 17.65364825s | 34.38 tokens/s |
qwen2.5vl:7b | 424 | 3672 | 48.192025208s | 27.186792ms | 359 token(s) | 4.229740167s | 84.88 tokens/s | 785 token(s) | 43.93446075s | 17.87 tokens/s |
qwen3:1.7b | 6 | 43 | ||||||||
qwen3:8b | 6 | 43 | ||||||||
stable-code:3b | 1611 | 15794 | 2m30.640837s | 27.450459ms | 370 token(s) | 1.48914325s | 248.47 tokens/s | 3790 token(s) | 2m29.1235375s | 25.42 tokens/s |
starcoder:7b | 0 | 3 | 2.160816625s | 18.622083ms | 341 token(s) | 2.08676s | 163.41 tokens/s | 2 token(s) | 54.53ms | 36.68 tokens/s |
System | |
ollama proc | 100% GPU |
ollama version | 0.9.3 |
sys arch | arm64 |
sys processor | arm |
sys memory | 15G + 2249M |
sys OS | Darwin 24.5.0 |