ikt to LocalLLaMA@sh.itjust.worksEnglish • 1 month ago[April 2025] Which model are you using?message-square13fedilinkarrow-up125arrow-down11file-text
arrow-up124arrow-down1message-square[April 2025] Which model are you using?ikt to LocalLLaMA@sh.itjust.worksEnglish • 1 month agomessage-square13fedilinkfile-text
Just thinking about making this a monthly post, which model are you using? what are the positives and negatives?
minus-square@BaroqueInMind@lemmy.onelinkfedilinkEnglish4•edit-230 days agoNot for GGUF converted models. Just run the following command in ollama ollama run hf.co/wanlige/li-14b-v0.4-Q4_K_M-GGUF I also recommend you set up Open WebUI as your front-end instead of staying in a terminal. Also, look into “abliterated” uncensored models. There’s plenty of them on hf that are already converted for you
Not for GGUF converted models.
Just run the following command in ollama
ollama run hf.co/wanlige/li-14b-v0.4-Q4_K_M-GGUFI also recommend you set up Open WebUI as your front-end instead of staying in a terminal.
Also, look into “abliterated” uncensored models. There’s plenty of them on hf that are already converted for you
That’s awesome thank you.