Llms

Intro Large language models (LLMs) are impressive, capable of generating human-quality text, translating languages, and answering questions. However, there’s a catch: they are limited to the data they were trained on. This means their knowledge can be outdated and they may struggle with topics that emerged after their training. But what if we could give our LLMs access to the vast ocean of information available on the web? This powerful combination would allow your local LLMs to:...

Privately chat with your own data using RAG.

A walk through of how I run LLMs locally, in a Crew-like fashion.

How to self host a web UI to interact with LLMs, local or remote

How to easily run local LLMs