Posts

A walk through of how I run LLMs locally, in a Crew-like fashion.

How to self host a web UI to interact with LLMs, local or remote

How to easily run local LLMs

A full example of this repository can be found on my Github here. I often find myself exploring data using Python, Jupyter Lab, Pandas and various graphing programs. This has caused me to want to have a light weight, easy to use, and portable approach to standing up these tools. In the past, I have found myself using tools like pyenv to install a desired version of python for each project....

Mod compatibility was broken by a new update…

test

Using Docker

We’re going to leverage Docker, Cloudflare DNS, and Caddy to set up a reverse proxy for our home-lab, which is both easy to configure, and automatically handles SSL certs for us. Previously, I used Nginx Proxy Manager, but I’ve grown to not love this application, as its both difficult to have your configurations live in code, as well to have SSL certifications both be made, and renewed automatically. Additionally, I previously used Namecheap DNS, as my domains are registered there, but I have found their API to be less then desirable....

I’ve been maintaining a sourdough culture since early 2020. It’s lived in three different homes, and has been driven across the entire country. I’m always trying to convince anyone to get into baking bread, and frequently give away part of my culture, so someone else can begin enjoying sourdough bread. This post is being written so I can share how to take care of one’s sourdough with friends and family. Everything I’m about to write can be more formally learned by following the wonderful King Arthur sour dough recipe, which all of this is based on....

What a task’s priority is, and a few simple techniques to make prioritization easier