ollama-multirun: describe_this_image____docs_logo_logo_250_jpg: 20250614-143922

models: granite3.2-vision:2b minicpm-v:8b qwen2.5vl:3b qwen2.5vl:7b gemma3:4b llava:7b llava-llama3:8b llava-phi3:3.8b bakllava:7b moondream:1.8b

Prompt: (raw) (yaml) words:4 bytes:46

./docs/logo/logo-250.jpg

model words bytes total
duration
load
duration
prompt eval
count
prompt eval
duration
prompt eval
rate
eval
count
eval
duration
eval
rate
granite3.2-vision:2b 395 2440 43.142309167s 15.027959ms 2240 token(s) 18.446269875s 121.43 tokens/s 576 token(s) 24.679096333s 23.34 tokens/s
minicpm-v:8b 206 1265 17.714895875s 19.587792ms 77 token(s) 6.138328375s 12.54 tokens/s 233 token(s) 11.555399709s 20.16 tokens/s
qwen2.5vl:3b 59 372 4.391795292s 20.728458ms 114 token(s) 2.472197333s 46.11 tokens/s 73 token(s) 1.897868625s 38.46 tokens/s
qwen2.5vl:7b 82 501 7.630166709s 22.544334ms 114 token(s) 2.522926208s 45.19 tokens/s 97 token(s) 5.083655042s 19.08 tokens/s
gemma3:4b 201 1302 52.013899708s 28.837666ms 274 token(s) 42.760697584s 6.41 tokens/s 269 token(s) 9.223268625s 29.17 tokens/s
llava:7b 139 843 13.587836083s 15.173708ms 592 token(s) 3.835423s 154.35 tokens/s 185 token(s) 9.735239875s 19.00 tokens/s
llava-llama3:8b 77 425 9.838075125s 20.800542ms 591 token(s) 4.466867917s 132.31 tokens/s 92 token(s) 5.349246625s 17.20 tokens/s
llava-phi3:3.8b 161 871 10.020088958s 10.895583ms 594 token(s) 2.882995s 206.04 tokens/s 204 token(s) 7.124726833s 28.63 tokens/s
bakllava:7b 52 303 7.299771958s 10.110625ms 596 token(s) 4.000858625s 148.97 tokens/s 65 token(s) 3.287105709s 19.77 tokens/s
moondream:1.8b 52 329 5.97454075s 15.452166ms 743 token(s) 4.941445792s 150.36 tokens/s 63 token(s) 1.015943958s 62.01 tokens/s


System
ollama proc100% GPU
ollama version0.9.0
sys archarm64
sys processorarm
sys memory15G + 1145M
sys OSDarwin 24.5.0