bartowski/Llama-3.2-3B-Instruct-GGUF
- Author:bartowski
- Downloads:145410
- Likes:137
- Updated:08.10.2024
- License:llama3.2
What do people say...
- Would recommend? yes! ↑
- Quantization Q8_0
Runs at reasonable speed on a smartphone (llama.cpp on **CPU**). Not like it's ready for production but enough for translation or minimal chit chat.