A new gateway from F5 is aimed at helping enterprises to better manage AI security and delivery.
The F5 AI Gateway offers an automated way for customers to secure and manage interactions among AI applications, APIs, and large language models (LLMs). It’s a containerized Kubernetes service that can be deployed on its own or integrated with existing F5 software, hardware or services, the company stated. The gateway supports popular AI models such as OpenAI, Anthropic, Ollama as well as generic HTTP upstream LLMs and small language model (SLM) services.
AI applications present unique challenges with respect to security, monitoring, and delivery, according to Lori MacVittie, a distinguished engineer in F5’s CTO office.
“A significant challenge is due to the non-deterministic nature of AI applications. That is, inbound input and outbound responses vary greatly and evolve over time. AI applications can also pull in data from both structured and unstructured sources that can span multiple locations,” MacVittie wrote in a
SOCIAL SHARE CARD GENERATOR