Skip to content

Overview

Slow Wifi?

This tutorial will walk you through the process of setting-up an open-source LLM stack that has been proven to be scalable to thousands of users. For some additional context on how we leverage this stack at Dartmouth, check out this slide deck.

Simple Deployment

For a single user environment, you can get running quickly by running the command below.

Simple Stack

DATA_DIR=~/.open-webui uvx --python 3.11 open-webui@latest serve

Expanded Deployment

This tutorial will cover a more comprehensive deployment that is suitable for a multi-user environment.

Expanded Stack