ollama-multirun: swdub3jligfsbcbwcmv2aw91cybpbnn0cnvjdglvbnmucklnbm: huihui_ai/baronllm-abliterated:8b: 20250703-153147

models: bakllava:7b codellama:7b deepcoder:1.5b deepseek-r1:1.5b deepseek-r1:8b dolphin-mistral:7b dolphin3:8b gemma3:1b gemma3:4b gemma:2b granite3.2-vision:2b granite3.3:2b huihui_ai/baronllm-abliterated:8b llama3-groq-tool-use:8b llama3.2:1b llava-llama3:8b llava-phi3:3.8b llava:7b minicpm-v:8b mistral:7b qwen2.5-coder:7b qwen2.5vl:3b qwen2.5vl:7b qwen3:1.7b qwen3:8b stable-code:3b starcoder:7b

Prompt: (raw) (yaml) words:1 bytes:229

Output: huihui_ai/baronllm-abliterated:8b (raw)

Stats (raw)
words72
bytes415
total duration6.066471625s
load duration31.108625ms
prompt eval count164 token(s)
prompt eval duration1.388002958s
prompt eval rate118.16 tokens/s
eval count84 token(s)
eval duration4.646813583s
eval rate18.08 tokens/s
Model (raw)
namehuihui_ai/baronllm-abliterated:8b
architecturellama
size7.0 GB
parameters8.0B
context length131072
embedding length4096
quantizationQ4_K_M
capabilitiescompletion
tools
System
ollama proc100% GPU
ollama version0.9.3
sys archarm64
sys processorarm
sys memory15G + 3302M
sys OSDarwin 24.5.0