I have been an IT Guy for over 20 years. I took a vacation a year ago to see what the "AI Craze" was really about. That time off changed my life.
I feel that with AI as an assistant, your only limitation is your imagination. It opened my eyes to the future. This triggered me to go all in… and look where we are today.
Dr. MindBender is currently hosted in a few Docker Containers on a $23 server from Ebay. The base is Ollama, an open-source platform to manage local LLMs. In conjunction with this I have LiteLLM installed, used for model pricing, tracking, and routing.
The user interface is Open WebUI — the platform to run AI on your own terms. Open WebUI is the frontend with Ollama and LiteLLM on the backend. Open WebUI has an extension called Open Terminal that gives it direct access to the project folder you are working in.
Opencode is installed as a standalone AI interface.
I use Nginx Proxy Manager to route internet traffic to internal applications.