Prompt: (raw) (yaml)
words:143 bytes:1093
model | words | bytes | total duration |
load duration |
prompt eval count |
prompt eval duration |
prompt eval rate |
eval count |
eval duration |
eval rate |
---|---|---|---|---|---|---|---|---|---|---|
qwen2.5-coder:7b | 176 | 1355 | 21.0618275s | 17.523875ms | 309 token(s) | 2.128589208s | 145.17 tokens/s | 333 token(s) | 18.915040709s | 17.61 tokens/s |
codellama:7b | 123 | 891 | 16.098172167s | 12.354584ms | 336 token(s) | 2.424721084s | 138.57 tokens/s | 263 token(s) | 13.660186916s | 19.25 tokens/s |
starcoder:7b | 69 | 647 | 14.7156465s | 13.070709ms | 319 token(s) | 2.017135666s | 158.15 tokens/s | 224 token(s) | 12.684782125s | 17.66 tokens/s |
stable-code:3b | 133 | 1012 | 9.35481075s | 10.891875ms | 365 token(s) | 1.450132083s | 251.70 tokens/s | 299 token(s) | 7.893164584s | 37.88 tokens/s |
deepcoder:1.5b | 4497 | 28816 | 2m27.492376667s | 19.729333ms | 283 token(s) | 477.227542ms | 593.01 tokens/s | 6146 token(s) | 2m26.994775583s | 41.81 tokens/s |
dolphin3:8b | 87 | 739 | 14.605707125s | 16.04ms | 303 token(s) | 2.162709084s | 140.10 tokens/s | 199 token(s) | 12.426358583s | 16.01 tokens/s |
gemma:2b | 130 | 966 | 6.552518792s | 20.451917ms | 321 token(s) | 650.661167ms | 493.34 tokens/s | 258 token(s) | 5.880852083s | 43.87 tokens/s |
granite3.3:2b | 112 | 898 | 7.155068625s | 14.689708ms | 326 token(s) | 976.61575ms | 333.81 tokens/s | 228 token(s) | 6.162484166s | 37.00 tokens/s |
mistral:7b | 171 | 1238 | 20.808285333s | 11.120625ms | 321 token(s) | 2.146399917s | 149.55 tokens/s | 347 token(s) | 18.650058625s | 18.61 tokens/s |
qwen3:1.7b | 2766 | 17261 | 1m59.683683833s | 19.611833ms | 290 token(s) | 553.142ms | 524.28 tokens/s | 4514 token(s) | 1m59.110299625s | 37.90 tokens/s |
System | |
ollama proc | 100% GPU |
ollama version | 0.9.0 |
sys arch | arm64 |
sys processor | arm |
sys memory | 12G + 646M |
sys OS | Darwin 24.5.0 |