AI General Thread

[Legend]

Always funny how they try to save face. "We're both right!"

https://ollama.com/huihui_ai/mistral-small-abliterated

This one is a 14 GB model. 

My system only has 10 GB VRAM, so it uses some system RAM. 

Oh, way too much. I need something lightweight. Don't know what I am doing.

[the-pi-guy]

Always funny how they try to save face. "We're both right!"


Oh, way too much. I need something lightweight. Don't know what I am doing.

How much VRAM you got? 

And how much RAM? 

[Legend]

How much VRAM you got?

And how much RAM?

I'm exploring using an llm locally inside a videogame, so not much 


Probably not worth the hassle.