Large Language Models (LLMs)

 Like many others right now, I’ve jumped headfirst into exploring local Large Language Models (LLMs) and building my own AI agents. It’s a fascinating space, but I’ve quickly run into a classic hardware bottleneck: my current machine doesn't have a dedicated graphics card (GPU), which makes running these models locally incredibly sluggish.

However, the silver lining is the rapid shift in how these models are being built. There is a massive industry trend toward optimizing smaller, highly efficient LLMs designed to run on low-power devices like mobile phones.

By extension, this means a lot of development is going into making models run efficiently on standard computer CPUs and system RAM, without the absolute necessity of a beefy graphics card. Given the current, staggering pace of AI development, I’m optimistic that a perfectly capable, highly optimized local LLM that runs smoothly on my current hardware setup is only a matter of weeks away.

Note to self: Keep an eye on smaller parameter models (1B–3B) and CPU-optimized formats as this space evolves.