After more than 16 months of development, I'm excited to finally release LLM Controller Community Edition (CE) v1.0 as open-source software.
LLM Controller CE is a self-hosted, local-first web application for running and managing GGUF language models through llama-server It combines conversations, model management, runtime control, benchmarking, GPU monitoring, live logs, installation, and administration into a single browser interface.
The goal was never to build just another chat interface. I wanted local AI to feel like a complete product that you can install, manage, and use on hardware you control.
LLM Controller CE has been validated on both Windows and Ubuntu Linux, supports NVIDIA and AMD GPU environments where compatible tooling is available, and is released under the GPLv3 open-source license.
This has been one of the largest software projects I've built, and I'm incredibly happy to finally share it.
A quick update from the everything-is-moving-at-once department.
LLM Controller CE 1.0 is now in final testing before release, with the launch currently targeting June 6. What started as an experiment last February has fully evolved into complete software, and I’m now testing it in as many different configurations as I can before calling Version 1.0 done.
Alongside that, I’m still working through the broader stabilization of the nickdodd.com codebase. A lot of that work is behind-the-scenes cleanup, but it matters: better stability, less weird legacy mess, fewer insecure old code paths, cleaner admin tools, and a site that is easier to keep building on.
Rasberry™ is also getting closer to soft-launch. This project has turned into an even bigger codebase than LLM Controller, and the new hosting platform behind it is really starting to come together as a proper hardware infrastructure hosting control portal.
So yeah...lots happening. Software, hosting, websites, testing, polishing.
This is a long post test of the BlueSky integration, if all goes well, when a post is over 300 characters it will be truncated and a "Read more..." Hypertext link will be appended that links to the nickdodd.com post for the same post but showing the characters beyond the 300 limit. This was a nifty feature that I created sometime in 2024! This post has been posted a few times, to check and verify the bugs present in the code. We have solved Hyperlinking, truncating, share UI on main site posts and Comment links back to BlueSky!