I already created some tutorials for how to run these two models locally with ollama and LM Studio. I'll add tutorial for oobabooga soon and
I already created some tutorials for how to run these two models locally with ollama and LM Studio. I'll add tutorial for oobabooga soon and also how to link these setups with Sugoi Toolkit
14B gguf q4_k_m:
https://sugoi-file.sfo3.cdn.digitaloceanspaces.com/sugoi14b.gguf
32B gguf q4_k_m:
https://sugoi-file.sfo3.cdn.digitaloceanspaces.com/sugoi32b.gguf
Connect with LM Studio
https://blog.sugoitoolkit.com/tutorial-sugoi-llm-14b-and-32b/
Connect with Ollama
https://blog.sugoitoolkit.com/sugoi-llm-14b-32b-with-ollama/
Connect with Oobabooga
https://blog.sugoitoolkit.com/sugoi-llm-14b-32b-with-lm-studio/
Connect with Sugoi Toolkit (after you use either of the programs above)
https://blog.sugoitoolkit.com/connecting-sugoi-14b-32b-to-sugoi-toolkit/
If you found anything interesting, feel free to share on our Discord server so everyone can learn from it