RelayOrb

RelayOrb - production-grade tool infrastructure

RelayOrb - Tool Control Plane for AI Agents

Route agent calls to versioned capabilities with contracts, governance, and observability.

Try the Anonymous DemoDeploy with TerraformView on GitHub

Gateway - Registry - Worker

Why RelayOrb

Ad-hoc tool wiring degrades quickly in production. RelayOrb adds the control-plane guarantees needed to keep agent tool calls reliable and auditable.

Contract-first validation

JSON Schema input/output validation prevents silent payload drift.

Governance and ownership

Capability namespaces are governed with explicit ownership boundaries.

Routing and health discovery

Gateway selects healthy providers through Registry heartbeats.

Idempotency and async jobs

Retry-safe invoke behavior and async jobs in full production mode.

Metrics, traces, alerts

Prometheus metrics and OTEL traces make tool behavior observable.

Secure by default

OIDC in prod with private internals behind Cloud Run IAM.

How it works

  1. Agent calls Gateway with capability ID and payload.
  2. Gateway validates auth, policy, and JSON schema contract.
  3. Registry returns healthy provider candidates.
  4. Gateway forwards to Worker and validates response schema.
  5. Metrics/traces are emitted for full request lifecycle visibility.

Try it in 30 seconds

The anonymous demo is intentionally constrained: read-only, allowlisted, and rate-limited. Canonical demo guidance stays indocs/DEMO.md.

Demo invoke (rag.search@v1)

curl -sS -X POST "http://34.8.48.11/v1/invoke" \
  -H "Content-Type: application/json" \
  -d '{
    "requestId": "demo-001",
    "caller": { "agentId": "anon" },
    "capability": "rag.search@v1",
    "payload": { "query": "What is RelayOrb?" }
  }'

Deploy with Terraform

Production and demo postures are available as Terraform Registry modules.

Prod module (OIDC-first)

Open module

khalidsaidi/relayorb/google

module "relayorb" {
  source  = "khalidsaidi/relayorb/google"
  version = "0.1.1"

  project_id     = "relayorb-prod"
  gateway_image  = "ghcr.io/khalidsaidi/relayorb-gateway:v0.1.1"
  registry_image = "ghcr.io/khalidsaidi/relayorb-registry:v0.1.1"
  worker_image   = "ghcr.io/khalidsaidi/relayorb-rag:v0.1.1"
  scraper_image  = "ghcr.io/khalidsaidi/relayorb-metrics-scraper:v0.1.1"
}

Demo module (anonymous posture)

Open module

khalidsaidi/relayorb-demo/google

module "relayorb_demo" {
  source  = "khalidsaidi/relayorb-demo/google"
  version = "0.1.0"

  project_id     = "relayorb-demo"
  gateway_image  = "ghcr.io/khalidsaidi/relayorb-gateway:v0.1.1"
  registry_image = "ghcr.io/khalidsaidi/relayorb-registry:v0.1.1"
  worker_image   = "ghcr.io/khalidsaidi/relayorb-rag:v0.1.1"
  scraper_image  = "ghcr.io/khalidsaidi/relayorb-metrics-scraper:v0.1.1"
}

Open source, production-shaped

Smokes + conformance harness validate behavior before changes ship.
Remote Terraform state and deployment verifier keep demo posture stable.
Weekly Terraform module smoke workflow catches registry/install regressions.
Runbook-driven operations with clear guardrails for public demo safety.