Wow, I haven't blogged since July. That checks out.
I've been very busy. Whether I'm working seven days a week, pulling all-nighters on Rasberry™, or disappearing into another LLM Controller CE update, apparently I know how to keep myself occupied.
Rasberry™ Hosting is now actively serving customer VMs, and I've been continuously improving the Account Management Portal since launch in August.
AMP has already gained a bunch of new customer-facing functionality, including VM reinstall, opening all firewall ports, subscription cancellation, automatic daily VM backups and restore, real-time server status, and Authenticator 2FA.
I've also done a full cleanup and typography consistency pass across the interface, and updated the base Ubuntu installation for tighter integration with AMP and a better experience right from first boot.
Behind all of that, the entire hosting cluster is backed up daily to a dedicated backup cluster.
We've also had nearly 100% uptime since launch. The only significant interruption wasn't actually a VM or hardware outage at all. An ISP outage took the host running AMP offline for around eight hours, while customer VMs continued running normally.
As of writing, the cluster itself is sitting at 162 days of uptime, dating back well before public signups opened.
On the open-source side, LLM Controller CE has been moving just as quickly.
Since my last blog post I've just released the 3rd major version!
LLM Controller CE has grown into much more than another llama.cpp wrapper. It's a workspace, model test bench, project manager, OpenAI-compatible API host, and a growing collection of tools for actually working with local models.
LLM Controller CE v1.4 puts a big focus on Voice and the overall user experience, including local speech-to-text so you can talk directly to your model whether the model itself supports audio or not. No external API required.
In considerably less software-related news, Jamie and I spent our one-year wedding anniversary in a beautiful condo in Whistler, up on Blackcomb Mountain and about as far away from everyone else as we could reasonably get.
We cooked at home, disconnected from everything, and relaxed our faces off for a few days. It was great.
Naturally, I came home and started tearing apart the server room.
I'm currently working through soundproofing, new drywall, fresh paint, and an entirely new cooling setup. It's one of those projects where every completed job reveals another job underneath it, but it's coming together.
So yeah.
I haven't blogged since July.
That checks out. I skipped a lot, too.
Rasberry™ Hosting is officially live!
After 17 years of running web hosting services in one form or another, Rasberry™ is the next evolution of that work: a cleaner platform, a better customer experience, and a more focused foundation for what comes next.
I’ve built and run the infrastructure myself, backed by the same proven track record that has kept my hosting services online for the past 17 years.
The first public offering is Ubuntu VPS hosting in Canada, with static IPs included and more services planned as the platform grows.
This is not my first step into hosting, it’s the start of Rasberry™ becoming its own modern hosting platform!
Check it out:
https://rasberry.ca/
This release builds on the foundation of v1.0 with a focus on making the system easier to operate, understand, and use every day.
Better Runtime Visibility
v1.1 improves visibility into what is actually happening behind your local AI stack. Runtime information, active processes, logs, GPU activity, and model status are easier to understand at a glance.
The goal remains simple: serious local inference starts with the hardware, and that hardware should be a first-class part of the experience.
Improved Benchmarks
The benchmark experience has been refined to make testing and comparing local models more practical, with a cleaner interface and improved usability across different screen sizes.
UI/UX Improvements and Polish
A broad round of interface improvements, usability fixes, and general polish has gone into v1.1, tightening up the experience across LLM Controller without changing what already worked.
LLM Controller CE is continuing to evolve as a self-hosted, local-first control layer for running and understanding local AI.
v1.1 is available now!
https://github.com/tensioncore/llm-controller-ce
After more than 16 months of development, I'm excited to finally release LLM Controller Community Edition (CE) v1.0 as open-source software.
LLM Controller CE is a self-hosted, local-first web application for running and managing GGUF language models through llama-server It combines conversations, model management, runtime control, benchmarking, GPU monitoring, live logs, installation, and administration into a single browser interface.
The goal was never to build just another chat interface. I wanted local AI to feel like a complete product that you can install, manage, and use on hardware you control.
LLM Controller CE has been validated on both Windows and Ubuntu Linux, supports NVIDIA and AMD GPU environments where compatible tooling is available, and is released under the GPLv3 open-source license.
This has been one of the largest software projects I've built, and I'm incredibly happy to finally share it.
I hope you enjoy using it as much as I enjoyed building it!