ollama-multirun: my_hovercraft_is_full_of_eels: starcoder:7b: 20250708-013839

models: codellama:7b cogito:8b deepcoder:1.5b deepseek-r1:1.5b deepseek-r1:8b dolphin-mistral:7b dolphin3:8b gemma3:1b gemma3:4b gemma3n:e2b gemma:2b granite3.3:2b hermes3:8b llama3.2:1b llama3.2:3b llava-llama3:8b llava-phi3:3.8b llava:7b minicpm-v:8b mistral:7b qwen2.5-coder:7b qwen2.5vl:3b qwen2.5vl:7b qwen3:0.6b qwen3:1.7b qwen3:4b qwen3:8b smollm2:1.7b smollm2:135m smollm2:360m stable-code:3b starcoder:7b

Prompt: (raw) (yaml) words:6 bytes:30

Output: starcoder:7b (raw)

Stats (raw)
words97
bytes737
total duration12.470546958s
load duration19.50625ms
prompt eval count8 token(s)
prompt eval duration294.7385ms
prompt eval rate27.14 tokens/s
eval count161 token(s)
eval duration12.155830708s
eval rate13.24 tokens/s
Model (raw)
namestarcoder:7b
architecturestarcoder
size5.9 GB 1.2 GB
parameters7.5B
context length8192
embedding length4096
quantizationQ4_0
capabilitiescompletion
System
Ollama proc100% GPU 100% GPU
Ollama version0.9.5
sys archarm64
sys processorarm
sys memory14G + 1338M
sys OSDarwin 24.5.0