Prompt: (raw) (yaml)
words:59 bytes:400
| model | words | bytes | total duration |
load duration |
prompt eval count |
prompt eval duration |
prompt eval rate |
eval count |
eval duration |
eval rate |
|---|---|---|---|---|---|---|---|---|---|---|
| granite3.2-vision:2b | 25 | 273 | 1m21.003448042s | 21.268792ms | 7426 token(s) | 1m9.828554167s | 106.35 tokens/s | 133 token(s) | 11.14637225s | 11.93 tokens/s |
| minicpm-v:8b | 2062 | 33122 | ||||||||
| qwen2.5vl:3b | 383 | 2471 | 2m8.185215959s | 25.018959ms | 1357 token(s) | 1m20.408666791s | 16.88 tokens/s | 1401 token(s) | 47.74676975s | 29.34 tokens/s |
| qwen2.5vl:7b | 359 | 2394 | 2m52.747582958s | 26.244041ms | 1357 token(s) | 1m24.454187541s | 16.07 tokens/s | 1409 token(s) | 1m28.2625735s | 15.96 tokens/s |
| gemma3:4b | 164 | 1053 | 16.8024505s | 31.33575ms | 347 token(s) | 8.954589083s | 38.75 tokens/s | 226 token(s) | 7.811937083s | 28.93 tokens/s |
| llava:7b | 873 | 14577 | ||||||||
| llava-llama3:8b | 4768 | 28685 | ||||||||
| llava-phi3:3.8b | 64 | 370 | 10.064836875s | 19.186083ms | 682 token(s) | 3.0589875s | 222.95 tokens/s | 188 token(s) | 6.979119459s | 26.94 tokens/s |
| bakllava:7b | 12 | 60 | 5.430265583s | 15.160583ms | 684 token(s) | 4.518544292s | 151.38 tokens/s | 18 token(s) | 890.619708ms | 20.21 tokens/s |
| moondream:1.8b | 4 | 27 | 5.331924292s | 20.888667ms | 824 token(s) | 5.00728925s | 164.56 tokens/s | 19 token(s) | 296.521292ms | 64.08 tokens/s |
| System | |
| ollama proc | 100% GPU |
| ollama version | 0.9.0 |
| sys arch | arm64 |
| sys processor | arm |
| sys memory | 15G + 1026M |
| sys OS | Darwin 24.5.0 |