Prompt: (raw) (yaml)
words:4 bytes:46
model | words | bytes | total duration |
load duration |
prompt eval count |
prompt eval duration |
prompt eval rate |
eval count |
eval duration |
eval rate |
---|---|---|---|---|---|---|---|---|---|---|
granite3.2-vision:2b | 395 | 2440 | 43.142309167s | 15.027959ms | 2240 token(s) | 18.446269875s | 121.43 tokens/s | 576 token(s) | 24.679096333s | 23.34 tokens/s |
minicpm-v:8b | 206 | 1265 | 17.714895875s | 19.587792ms | 77 token(s) | 6.138328375s | 12.54 tokens/s | 233 token(s) | 11.555399709s | 20.16 tokens/s |
qwen2.5vl:3b | 59 | 372 | 4.391795292s | 20.728458ms | 114 token(s) | 2.472197333s | 46.11 tokens/s | 73 token(s) | 1.897868625s | 38.46 tokens/s |
qwen2.5vl:7b | 82 | 501 | 7.630166709s | 22.544334ms | 114 token(s) | 2.522926208s | 45.19 tokens/s | 97 token(s) | 5.083655042s | 19.08 tokens/s |
gemma3:4b | 201 | 1302 | 52.013899708s | 28.837666ms | 274 token(s) | 42.760697584s | 6.41 tokens/s | 269 token(s) | 9.223268625s | 29.17 tokens/s |
llava:7b | 139 | 843 | 13.587836083s | 15.173708ms | 592 token(s) | 3.835423s | 154.35 tokens/s | 185 token(s) | 9.735239875s | 19.00 tokens/s |
llava-llama3:8b | 77 | 425 | 9.838075125s | 20.800542ms | 591 token(s) | 4.466867917s | 132.31 tokens/s | 92 token(s) | 5.349246625s | 17.20 tokens/s |
llava-phi3:3.8b | 161 | 871 | 10.020088958s | 10.895583ms | 594 token(s) | 2.882995s | 206.04 tokens/s | 204 token(s) | 7.124726833s | 28.63 tokens/s |
bakllava:7b | 52 | 303 | 7.299771958s | 10.110625ms | 596 token(s) | 4.000858625s | 148.97 tokens/s | 65 token(s) | 3.287105709s | 19.77 tokens/s |
moondream:1.8b | 52 | 329 | 5.97454075s | 15.452166ms | 743 token(s) | 4.941445792s | 150.36 tokens/s | 63 token(s) | 1.015943958s | 62.01 tokens/s |
System | |
ollama proc | 100% GPU |
ollama version | 0.9.0 |
sys arch | arm64 |
sys processor | arm |
sys memory | 15G + 1145M |
sys OS | Darwin 24.5.0 |