ollama-multirun: hi: llama3.1:8b-instruct-q4_1: 20250713-160230

models: codellama:7b cogito:3b cogito:8b deepcoder:1.5b deepseek-r1:1.5b deepseek-r1:14b deepseek-r1:8b dolphin-mistral:7b dolphin3:8b gemma3:1b gemma3:4b gemma3n:e2b gemma3n:e4b gemma:2b granite3.3:2b granite3.3:8b hermes3:8b llama3.1:8b-instruct-q4_1 llama3.2:1b llama3.2:3b llava-llama3:8b llava-phi3:3.8b llava:7b minicpm-v:8b mistral:7b mistral:7b-instruct qwen2.5-coder:7b qwen2.5vl:3b qwen2.5vl:7b qwen3:0.6b qwen3:1.7b qwen3:14b qwen3:4b qwen3:8b smollm2:1.7b smollm2:135m smollm2:360m

Prompt: (raw) (yaml) words:1 bytes:3

Output: llama3.1:8b-instruct-q4_1 (raw)

Stats (raw)
Words17
Bytes83
Total duration2.422103833s
Load duration31.1585ms
Prompt eval count11 token(s)
Prompt eval duration1.144180208s
Prompt eval rate9.61 tokens/s
Eval count21 token(s)
Eval duration1.245195542s
Eval rate16.86 tokens/s
Model (raw)
Namellama3.1:8b-instruct-q4_1
Architecturellama
Size12 GB
Parameters8.0B
Context length131072
Embedding length4096
QuantizationQ4_1
Capabilitiescompletion
tools
System
Ollama proc6%/94% CPU/GPU
Ollama context32768
Ollama version0.9.7-rc0
Multirun timeout300 seconds
Sys archarm64
Sys processorarm
sys memory15G + 1761M
Sys OSDarwin 24.5.0