minus-squareBeefAndPoultry@lemmus.orgtoNo Stupid Questions@lemmy.world•Is there anyway to use LLMs without supporting the billionaires/data centers but without also entirely upgrading your computer?linkfedilinkEnglisharrow-up1·4 days ago!localllama@sh.itjust.works Which model GPU and how much VRAM? 16GB RAM limits your options a bit but maybe LFM 2.5 24B-A2B If not, Gemma 4 e4b or Ling 3.0 Tiny are about as small and fast as you can get while still being decently smart. linkfedilink
!localllama@sh.itjust.works
Which model GPU and how much VRAM? 16GB RAM limits your options a bit but maybe LFM 2.5 24B-A2B
If not, Gemma 4 e4b or Ling 3.0 Tiny are about as small and fast as you can get while still being decently smart.