Running LLM models at the crib

[Macallik86]

I've had a passing interesting in AI for the last few years, but only realized in the last month or so that I don't need an expensive laptop to run models locally.

Share what you are running, what front-end you are using, any tips/tricks you know of, etc.

 

[bnew]

i've used LM Studio when i tested some quantized 6B & 7B models.

LM Studio - Discover, download, and run local LLMs

Run Llama, Gemma 3, DeepSeek locally on your computer.

lmstudio.ai

About LM Studio | LM Studio Docs

Learn how to run Llama, DeepSeek, Phi, and other LLMs locally with LM Studio.

lmstudio.ai

GitHub - nomic-ai/gpt4all: GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. - nomic-ai/gpt4all

github.com