An io Software product

fluxRelay

An AI gateway built for multi-tenant operations.

AI gateway

fluxRelay brings upstream key pools, per-call metered billing and day-to-day operations into one platform, for teams that resell quota, run managed services or offer prompt-based products. io Software's own systems route their AI calls through it.

Python
FastAPI
React
TypeScript

Documentation

Telemetry log: model, tokens, cost, latency and result per call

Features

Drop-in compatibility and high availability: connect Anthropic, OpenAI and Gemini without changing core code, with automatic failover and six key-rotation strategies.
A billing layer designed for resale: precise per-call metering and full multi-tenant isolation, with a margin multiplier and periodic budget per tenant.
Prompt-as-Product: a prompt is wrapped as an API endpoint, so clients pass variables and receive results without ever seeing the system prompt.
A built-in AI operations assistant: an agent with 30 tools that drafts and creates services and issues keys on instruction, with two-step confirmation and an audit trail for every action.

automated tests: 943; automated tests
upstream AI providers: 5; upstream AI providers
tools the AI assistant can use: 30; tools the AI assistant can use

From the code and test collection on 2026-10-07.

Next project

Campus election system

SAVote

A student-association e-voting system: campus SSO confirms eligibility, a zero-knowledge proof shows each ballot comes from an eligible voter, and ballots carry no identity.

View project