All projects
Bash XAI Platform — Layered LLM Platform
A layered, multi-tenant LLM platform (.NET 10) that exposes a unified API over multiple model providers, with reusable prompts, skills, and per-app key management. Multi-tenancy runs Admin → Customer → App → Employee over a Postgres keystore, with admin / customer / portal consoles. It powers downstream products such as freight load extraction.
.NET 10LLMOllamaOpenAIPostgreSQLpgvectorMulti-TenantDocker
What it does
Key features
- Unified LLM API across providers (self-hosted Ollama, OpenAI, and more)
- Multi-tenant model: Admin → Customer → App → Employee
- Per-app encrypted key store in PostgreSQL
- Reusable prompts and composable skills
- Usage metering backed by pgvector
- Domain skill: freight load extraction feeding the logistics products
- Admin, Customer and Portal consoles
Under the hood
Architecture
API.NET 10 layered service — unified LLM gateway, prompts, skills
ModelsSelf-hosted Ollama + hosted providers (OpenAI, …)
DatabasePostgreSQL + pgvector — app keystore and usage metering
ConsolesAdmin / Customer / Portal web consoles
DeploymentDocker on VPS (API :1380, Ollama :1381)
Interested in work like this?
Get in touch