| Model | Architecture | Parameters | Context length |
Embedding length |
Quantization | Temperature | Capabilities | System prompt | (raw) | (index) |
|---|---|---|---|---|---|---|---|---|---|---|
| deepseek-r1:8b | qwen3 | 8.2B | 131072 | 4096 | Q4_K_M | 0.6 | completion thinking |
raw | index | |
| dolphin3:8b | llama | 8.0B | 131072 | 4096 | Q4_K_M | completion |
You are Dolphin, a helpful AI assistant. | raw | index | |
| gemma3n:e2b | gemma3n | 4.5B | 32768 | 2048 | Q4_K_M | completion |
raw | index | ||
| gemma3n:e4b | gemma3n | 6.9B | 32768 | 2048 | Q4_K_M | completion |
raw | index | ||
| hf.co/bartowski/Ministral-8B-Instruct-2410-GGUF:IQ4_XS | llama | 8.0B | 32768 | 4096 | unknown | completion tools |
raw | index | ||
| hf.co/bartowski/Ministral-8B-Instruct-2410-GGUF:Q4_K_M | llama | 8.0B | 32768 | 4096 | unknown | completion tools |
raw | index | ||
| hf.co/bartowski/Ministral-8B-Instruct-2410-GGUF:Q5_K_M | llama | 8.0B | 32768 | 4096 | unknown | completion tools |
raw | index | ||
| hf.co/bartowski/Ministral-8B-Instruct-2410-GGUF:Q6_K | llama | 8.0B | 32768 | 4096 | unknown | completion tools |
raw | index | ||
| hf.co/bartowski/Ministral-8B-Instruct-2410-GGUF:Q6_K_L | llama | 8.0B | 32768 | 4096 | unknown | completion tools |
raw | index | ||
| mistral:7b | llama | 7.2B | 32768 | 4096 | Q4_K_M | completion tools |
raw | index | ||
| qwen2.5vl:7b | qwen25vl | 8.3B | 128000 | 3584 | Q4_K_M | 0.0001 | completion vision |
You are a helpful assistant. | raw | index |
| qwen3:8b | qwen3 | 8.2B | 40960 | 4096 | Q4_K_M | 0.6 | completion tools thinking |
raw | index |