ollama-multirun: my_hovercraft_is_full_of_eels: granite3.3:8b: 20250712-121106

models: codellama:7b cogito:3b cogito:8b deepcoder:1.5b deepseek-r1:1.5b deepseek-r1:14b deepseek-r1:8b dolphin-mistral:7b dolphin3:8b gemma3:1b gemma3:4b gemma3n:e2b gemma3n:e4b gemma:2b granite3.3:2b granite3.3:8b hermes3:8b llama3.1:8b-instruct-q4_1 llama3.2:1b llama3.2:3b llava-llama3:8b llava-phi3:3.8b llava:7b minicpm-v:8b mistral:7b mistral:7b-instruct qwen2.5-coder:7b qwen2.5vl:3b qwen2.5vl:7b qwen3:0.6b qwen3:1.7b qwen3:14b qwen3:4b qwen3:8b smollm2:1.7b smollm2:135m smollm2:360m stable-code:3b starcoder:7b

Prompt: (raw) (yaml) words:6 bytes:30

Output: granite3.3:8b (raw)

Stats (raw)
words48
bytes267
total duration1m7.771776209s
load duration17.285167ms
prompt eval count51 token(s)
prompt eval duration4.901366708s
prompt eval rate10.41 tokens/s
eval count66 token(s)
eval duration1m2.849480167s
eval rate1.05 tokens/s
Model (raw)
namegranite3.3:8b
architecturegranite
size23 GB
parameters8.2B
context length131072
embedding length4096
quantizationQ4_K_M
capabilitiescompletion
tools
System
Ollama proc53%/47% CPU/GPU
Ollama context65536
Ollama version0.9.7-rc0
sys archarm64
sys processorarm
sys memory15G + 724M
sys OSDarwin 24.5.0