BT Group introduces the GenAI Gateway, a platform powered by AWS, to streamline large language model usage and optimize GenAI integration.
BT Group Digital Unit has launched the GenAI Gateway, a platform that provides secure and scalable access to large language models (LLMs) from providers like Meta, Anthropic, Cohere, and Amazon. Built in collaboration with AWS, the platform utilizes Amazon Bedrock and SageMaker to enable BT Group to integrate AI technologies across its business in a controlled, efficient manner. This solution addresses key challenges with AI implementation, such as managing cost, security, and model performance, while ensuring that the company remains flexible in choosing the best models for each use case.
One major challenge the platform solves is the need for centralized management of LLMs to avoid duplication of efforts and resource waste. Traditionally, ad-hoc use of AI models leads to increased costs, security risks, and inefficiencies. GenAI Gateway consolidates AI model management into a single platform, allowing BT Group to monitor performance, prevent model decay, and control costs by tracking budgets for each use case. The platform also offers flexibility, enabling engineers to choose the most appropriate LLM for their specific needs.
The platform’s advanced security features are another key benefit. It includes central privacy controls, prompt security, and personal data filters to ensure compliance with UK data protection laws. Built-in guardrails prevent “jailbreak” risks and toxic interactions, enhancing both the safety and performance of AI applications. This centralized approach reduces the risks of errors and ensures ethical AI deployment, making the platform a critical tool for BT Group’s AI strategy.
Already live with initial beta use cases, such as summarizing engineering notes and contract analysis, the GenAI Gateway is positioned to drive quicker AI adoption across BT Group, boosting productivity and improving customer service.