Ask Your Documents ANYTHING (Free & Private!): Open Router & Open WebUI

Prerequisites
#

Find the complete list of available models at Open Router

Llama 3 8B (free)

meta-llama/llama-3-8b-instruct:free

Zephyr 7B (free)

huggingfaceh4/zephyr-7b-beta:free

Cinematika 7B (alpha) (free)

openrouter/cinematika-7b:free

Mistral 7B Instruct (free)

mistralai/mistral-7b-instruct:free

Nous: Capybara 7B (free)

nousresearch/nous-capybara-7b:free

OpenChat 3.5 (free)

openchat/openchat-7b:free

MythoMist 7B (free)

gryphe/mythomist-7b:free

Toppy M 7B (free)

undi95/toppy-m-7b:free

Open Router API Base URL

https://openrouter.ai/api/v1