Prompt: (raw) (yaml)
words:143 bytes:1093
model | words | bytes | total duration |
load duration |
prompt eval count |
prompt eval duration |
prompt eval rate |
eval count |
eval duration |
eval rate |
---|---|---|---|---|---|---|---|---|---|---|
qwen2.5-coder:7b | 175 | 1238 | 21.319922584s | 19.986084ms | 309 token(s) | 2.901868083s | 106.48 tokens/s | 306 token(s) | 18.397385542s | 16.63 tokens/s |
codellama:7b | 265 | 1780 | 27.592548208s | 19.398ms | 336 token(s) | 2.711845208s | 123.90 tokens/s | 464 token(s) | 24.860334333s | 18.66 tokens/s |
starcoder:7b | 0 | 5 | 2.102619083s | 13.839583ms | 319 token(s) | 2.030820375s | 157.08 tokens/s | 2 token(s) | 57.277667ms | 34.92 tokens/s |
stable-code:3b | 141 | 1177 | 10.547121291s | 14.478541ms | 365 token(s) | 1.58531575s | 230.24 tokens/s | 333 token(s) | 8.946574167s | 37.22 tokens/s |
deepcoder:1.5b | 4309 | 26649 | 2m18.403313084s | 19.842292ms | 283 token(s) | 411.483834ms | 687.75 tokens/s | 5922 token(s) | 2m17.971382333s | 42.92 tokens/s |
dolphin3:8b | 120 | 918 | 16.30559675s | 19.635916ms | 303 token(s) | 2.0743415s | 146.07 tokens/s | 243 token(s) | 14.21076425s | 17.10 tokens/s |
gemma:2b | 174 | 1060 | 6.541489792s | 21.336125ms | 321 token(s) | 619.854542ms | 517.86 tokens/s | 276 token(s) | 5.899745s | 46.78 tokens/s |
granite3.3:2b | 146 | 1079 | 7.6524505s | 15.909542ms | 326 token(s) | 936.218208ms | 348.21 tokens/s | 256 token(s) | 6.699408667s | 38.21 tokens/s |
mistral:7b | 151 | 1124 | 18.3125785s | 14.693791ms | 321 token(s) | 2.087537875s | 153.77 tokens/s | 322 token(s) | 16.209488791s | 19.86 tokens/s |
qwen3:1.7b | 6 | 43 |
System | |
ollama proc | 100% GPU |
ollama version | 0.9.0 |
sys arch | arm64 |
sys processor | arm |
sys memory | 14G + 795M |
sys OS | Darwin 24.5.0 |