Prompt: (raw) (yaml)
words:4 bytes:46
model | words | bytes | total duration |
load duration |
prompt eval count |
prompt eval duration |
prompt eval rate |
eval count |
eval duration |
eval rate |
---|---|---|---|---|---|---|---|---|---|---|
granite3.2-vision:2b | 395 | 2440 | 45.944637166s | 14.87575ms | 2240 token(s) | 19.933317958s | 112.37 tokens/s | 576 token(s) | 25.995092958s | 22.16 tokens/s |
minicpm-v:8b | 111 | 687 | 13.910486042s | 19.556542ms | 77 token(s) | 7.112288417s | 10.83 tokens/s | 130 token(s) | 6.777111416s | 19.18 tokens/s |
qwen2.5vl:3b | 59 | 372 | 4.235346166s | 21.385666ms | 114 token(s) | 2.169789125s | 52.54 tokens/s | 73 token(s) | 2.042057459s | 35.75 tokens/s |
qwen2.5vl:7b | 82 | 501 | 8.075072292s | 22.163417ms | 114 token(s) | 2.559128875s | 44.55 tokens/s | 97 token(s) | 5.492862s | 17.66 tokens/s |
gemma3:4b | 211 | 1360 | 52.343669416s | 29.471166ms | 274 token(s) | 42.075410167s | 6.51 tokens/s | 280 token(s) | 10.237751958s | 27.35 tokens/s |
llava:7b | 101 | 571 | 11.440831208s | 14.90275ms | 592 token(s) | 3.971998958s | 149.04 tokens/s | 131 token(s) | 7.451343s | 17.58 tokens/s |
llava-llama3:8b | 131 | 738 | 14.459823125s | 21.420916ms | 591 token(s) | 4.670223s | 126.55 tokens/s | 155 token(s) | 9.767223125s | 15.87 tokens/s |
llava-phi3:3.8b | 169 | 1021 | 11.586295584s | 12.777459ms | 594 token(s) | 2.895120542s | 205.17 tokens/s | 232 token(s) | 8.676939833s | 26.74 tokens/s |
bakllava:7b | 75 | 484 | 9.304359083s | 11.708083ms | 596 token(s) | 4.090424125s | 145.71 tokens/s | 95 token(s) | 5.200640708s | 18.27 tokens/s |
moondream:1.8b | 52 | 329 | 6.344019375s | 14.349958ms | 743 token(s) | 5.272647333s | 140.92 tokens/s | 63 token(s) | 1.055431792s | 59.69 tokens/s |
System | |
ollama proc | 100% GPU |
ollama version | 0.9.0 |
sys arch | arm64 |
sys processor | arm |
sys memory | 15G + 1289M |
sys OS | Darwin 24.5.0 |