Prompt: (raw) (yaml)
words:59 bytes:400
| model | words | bytes | total duration |
load duration |
prompt eval count |
prompt eval duration |
prompt eval rate |
eval count |
eval duration |
eval rate |
|---|---|---|---|---|---|---|---|---|---|---|
| granite3.2-vision:2b | 25 | 273 | 1m26.904509625s | 11.754208ms | 7426 token(s) | 1m15.212887167s | 98.73 tokens/s | 133 token(s) | 11.675190833s | 11.39 tokens/s |
| minicpm-v:8b | 122 | 893 | 1m19.025064583s | 24.105791ms | 723 token(s) | 1m6.30935775s | 10.90 tokens/s | 243 token(s) | 12.686061125s | 19.15 tokens/s |
| qwen2.5vl:3b | 383 | 2471 | 2m8.835863792s | 24.66225ms | 1357 token(s) | 1m20.840720417s | 16.79 tokens/s | 1401 token(s) | 47.966341291s | 29.21 tokens/s |
| qwen2.5vl:7b | 359 | 2394 | 2m54.638650167s | 25.281667ms | 1357 token(s) | 1m25.978753292s | 15.78 tokens/s | 1409 token(s) | 1m28.627275416s | 15.90 tokens/s |
| gemma3:4b | 7 | 6959 | ||||||||
| llava:7b | 102 | 631 | 15.041461959s | 19.865667ms | 680 token(s) | 4.487220958s | 151.54 tokens/s | 202 token(s) | 10.526412958s | 19.19 tokens/s |
| llava-llama3:8b | 152 | 761 | 19.725413416s | 24.278416ms | 670 token(s) | 4.937712209s | 135.69 tokens/s | 246 token(s) | 14.758898208s | 16.67 tokens/s |
| llava-phi3:3.8b | 55 | 313 | 6.747710666s | 20.701541ms | 682 token(s) | 3.139076s | 217.26 tokens/s | 102 token(s) | 3.5794635s | 28.50 tokens/s |
| bakllava:7b | 10 | 65 | 5.095629792s | 13.81225ms | 684 token(s) | 4.456079333s | 153.50 tokens/s | 13 token(s) | 620.179458ms | 20.96 tokens/s |
| moondream:1.8b | 4 | 27 | 5.254747708s | 20.661042ms | 824 token(s) | 4.930919666s | 167.11 tokens/s | 19 token(s) | 296.206334ms | 64.14 tokens/s |
| System | |
| ollama proc | 100% GPU |
| ollama version | 0.9.0 |
| sys arch | arm64 |
| sys processor | arm |
| sys memory | 15G + 1177M |
| sys OS | Darwin 24.5.0 |