Janus Security Gateway

Janus is an enterprise-grade AI edge proxy designed to secure, route, and audit LLM traffic. Built in Go for sub-millisecond network I/O, it implements a polyglot architecture utilizing gRPC to communicate with a dedicated Python sidecar for asynchronous Small Language Model (SLM) security inference. The system prioritizes architectural resilience and zero-trust governance. Core capabilities include a Redis-backed Token Bucket algorithm for distributed rate limiting, declarative YAML configuration for seamless provider failovers (Circuit Breaker pattern), and out-of-band malicious payload interception to prevent token burn. By isolating the inference engine from the core reverse proxy, Janus provides strict data sovereignty and prompt injection defense without sacrificing the Time-To-First-Token (TTFT) performance critical to production AI applications.