Skip to content

AI WorkbenchA self-hosted retrieval control plane for Astra.

Stand up workspaces, knowledge bases, ingest pipelines, agents, and a retrieval playground in one Docker image. Stable /api/v1/* contract. MIT-licensed. Backend-pluggable from in-memory to Astra tables.

1
Docker image β€” runtime + UI
3
Pluggable control-plane backends
12+
Workspace-scoped resource kinds
MIT
License β€” fork freely

What you get ​

AI Workbench is the control plane between your team's data sources and the agents you want to ground on them. It's the surface where someone on the operations side picks "ingest this PDF into the policy KB" and the surface where someone on the application side decides "this agent should retrieve from policy + tickets but not invoices."

The implementation is intentionally boring underneath: a Hono HTTP runtime, Zod at every boundary, the Astra Data API SDK for storage, and a conformance harness so the contract holds across runtimes.

Quickstart ​

Boot with the in-memory control plane β€” no external services required.

bash
git clone https://github.com/datastax/ai-workbench
cd ai-workbench
npm ci && npm run install:ts

npm run dev                            # http://localhost:8080
curl http://localhost:8080/healthz     # {"status":"ok"}
curl http://localhost:8080/docs        # Scalar-rendered API reference

Want a durable control plane? Switch to Astra tables β€” it's a YAML change. See Configuration. The runtime can even auto-detect Astra credentials from the astra CLI if you have a profile configured.

Map the docs ​

  • Product overview β€” workflows, mental model, and the quickstart path.
  • Architecture β€” components, data flow, and how the layers fit together.
  • Green boxes β€” the multi-runtime story: TS today, Python and Java scaffolds tracking the same contract.
  • API spec β€” every /api/v1/* route with request / response shape.
  • Authentication β€” middleware, OIDC login, silent refresh, threat model.
  • Audit logging β€” what gets logged, the envelope, and the doc-drift test.
  • Configuration β€” workbench.yaml schema reference.
  • Workspaces β€” scoping, cascade semantics, defaults.
  • Playground β€” UX for text / vector / hybrid / rerank, ingest dialog.
  • Agents β€” personas, RAG defaults, per-agent LLM binding, conversation routes.
  • MCP server β€” expose a workspace as MCP tools for external agents.
  • Conformance β€” cross-runtime contract testing.
  • Roadmap β€” phased delivery plan and open questions.

License ​

AI Workbench is MIT-licensed β€” fork it, embed it, ship it. Issues and pull requests welcome on GitHub.

Released under the MIT license.