caferemote
Pfizer

GenAI Platform Engineer – LLM Gateway

Remote India Full-time Posted 2h ago
Apply now
Work from
India
Contract
Full-time
Posted
18 November 2026
Apply by
17 January 2027

The GenAI Platform Engineering team builds and runs the shared platform that lets Pfizer colleagues and applications use generative AI safely and at scale. At its core is the enterprise GenAI Gateway: a single, governed entry point to large language models from multiple providers, with self-service access, routing, usage and cost transparency, and observability built in.

About the role

Around it, we deliver evaluation, observability and agentic tooling — MCP integrations, agent registries and reusable agent skills — for teams across the company.

We run the platform as a product: self-service over tickets, automation over manual approvals, small and frequent releases, and reliability we can measure. We are looking for a hands-on engineer to help evolve the Gateway and its ecosystem. You will keep it secure, fast and current in a fast-moving open-source landscape. You will work closely with a globally distributed team and with the teams that build on the platform.

This is an individual contributor role.

ROLE RESPONSIBILITIES

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Computer Applications, Engineering or a related field, or equivalent practical experience.
  • 9+ years of professional software engineering experience, including 3+ years building GenAI/LLM-based applications or platforms used in production.
  • Strong Python skills for backend services: async programming, FastAPI or similar, REST APIs and streaming responses.
  • Hands-on experience with LLM provider APIs (e.g., OpenAI, Azure OpenAI, AWS Bedrock), including tool/function calling and integrating multiple providers.
  • Experience delivering and running services on AWS with containers and CI/CD pipelines (e.g., Docker, GitHub Actions), with automated testing built into the workflow.
  • Proven ability to troubleshoot complex production issues and perform root-cause analysis.
  • Clear written and verbal communication in English, and comfort working with distributed, cross-functional teams.

Nice to have

  • Experience with an AI/LLM gateway or API gateway, including routing, key management and cost tracking.
  • Experience running and extending open-source software in production, including patches, upgrades, regression testing and upstream contributions.
  • Knowledge of agentic AI patterns and tooling:
    • MCP
    • LangGraph/LangChain or similar frameworks
    • multi-agent orchestration
    • RAG and vector search
  • Experience with performance/load testing and observability tooling (e.g., OpenTelemetry, Langfuse, Prometheus/Grafana).
  • Experience with Kubernetes and Infrastructure as Code (Terraform).
  • Frontend skills (React, TypeScript) for internal tools and portals.
  • Daily use of AI-assisted development tools (e.g., GitHub Copilot, Claude Code) and interest in building reusable agent skills.
  • Experience in pharmaceutical, healthcare or other regulated environments.
  • Experience mentoring engineers or delivering technical enablement, such as workshops, documentation and onboarding.
  • AWS certification.

WORK SCHEDULE

  • Regular collaboration with colleagues in European time zones.
  • Participation in the team’s support rotation.

Pfizer is an equal opportunity employer and complies with all applicable equal employment opportunity legislation in each jurisdiction in which it operates.

To learn more about acceptable and prohibited uses of AI during the recruitment process, please review our candidate AI-use guidelines available on Pfizer Careers.

Information & Business Tech

Platform engineering

  • Design, build and operate features of the enterprise LLM gateway, mainly in Python:
    • multi-provider model access
    • routing and failover
    • API key and access management
    • budgets, usage metering and chargeback
  • Integrate agentic capabilities into the platform with the right security controls. Examples include Model Context Protocol (MCP) servers, tool calling across providers, and agent-to-agent connectivity.
  • Keep the platform’s open-source foundations current. Assess upstream releases, maintain and retire Pfizer-specific extensions, and deliver upgrades without regressions.
  • Contribute to the platform’s admin and self-service experiences, including web UI, portals and developer documentation.

Quality, reliability and security

  • Build and maintain automated quality gates in CI/CD. These include unit, integration, contract and performance/load tests that protect every release.
  • Instrument services with metrics, traces and logs (e.g., OpenTelemetry, Langfuse). Use them to find and fix latency, error and cost issues.
  • Take part in the support/on-call rotation. Lead root-cause analysis of production incidents, and turn the findings into lasting fixes and blameless postmortems.
  • Apply secure-by-default engineering:
    • identity and access controls (SSO, OAuth 2.0/OIDC, RBAC)
    • secret handling
    • dependency pinning and supply-chain hygiene

Enablement and collaboration

  • Evaluate emerging GenAI capabilities hands-on, such as model routing, guardrails and agent registries. Turn the results into clear recommendations on whether to adopt them.
  • Help consuming teams onboard and succeed. Write guides and runbooks, and create reusable assets such as code samples and AI agent skills.
  • Work in the open. Make InnerSource contributions, review code, and engage with open-source communities and vendors by reporting issues and proposing fixes upstream.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Pfizer

View company →

Internal Medicine Health & Science System Specialist - Houston N, TX

Pfizer
Remote United States Full-time $108K – $250K / year

ROLE SUMMARY Everything we do, every day, is in line with an unwavering commitment to the quality and the delivery of safe and effective products to patients.…

2 days ago Customer Support

Field Medical Excellence TA Lead - US

Pfizer
Remote United States Full-time $176K – $294K / year

ROLE SUMMARY This Director‑level role supports and facilitates medical analytics and insights activities aligned with Field Medical Excellence guidance to…

3 days ago Data

Oncology Field Medical, Director (non-MD), STEP

Pfizer
Remote United States Full-time $176K – $294K / year

Oncology Field Medical, Director (non-MD), Solid Tumors and Early Pipeline The Oncology Field Medical, Director is responsible for providing therapeutic…

6 days ago All Other Remote

Director, Thought Leader Engagement (TLEL)

Pfizer
Remote United States Full-time $176K – $294K / year

Role Summary The Director, Thought Leader Engagement (TLEL) is responsible for partnering with marketeers to develop and execute a best-in-class, compliant…

7 days ago Sales and Marketing

Similar remote jobs

Browse all →

Staff Data Engineer - Data COE

Pearson
Remote United Kingdom Full-time

Job Title: Staff Data Engineer About the Role We are seeking an Analytics Engineer to design, build, and operate our analytics and automations as well as build of AI-powered automations and…

2h ago DevOps and Sysadmin

Software Engineer IV/Tech Lead - Platform

AbsenceSoft, LLC
Remote United States Full-time $179K – $224K / year

At AbsenceSoft, we’re transforming the employee experience. Our secure, intuitive technology helps employers bring humanity, certainty, and efficiency to some of the most complex moments…

3h ago DevOps and Sysadmin

Cloud and Observability Engineer (Remote Role, 6pm - 3am)

Coralogix
Remote India Full-time

Description Coralogix is a modern, full-stack observability platform transforming how businesses process and understand their data. Our unique architecture powers in-stream analytics…

3h ago DevOps and Sysadmin

Professional Services Technical Operations Engineer- Agentic AI

Crowdstrike
Remote United States Full-time $120K – $185K / year

As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations. Since 2011, our mission hasn’t changed — we’re here…

3h ago DevOps and Sysadmin

Senior Technical Support Engineer - Customer Support (all genders)

ABOUT YOU SE & Co. KG
Remote United States Full-time $88K – $155K / year

Investigate technical issues reported by enterprise customers - analyse symptoms, form hypotheses, follow the evidence to the root cause Use observability tooling (Datadog logs, traces,…

3h ago DevOps and Sysadmin

Senior DevOps Engineer

Time Doctor
Remote Anguilla, Antigua and Barbuda, Argentina, Aruba, Bahamas, Barbados, Belize, Bermuda, Bolivia, Bonaire, Sint Eustatius and Saba, Brazil, Cayman Islands, Chile, Colombia, Costa Rica, Cuba, Dominica, Dominican Republic, Ecuador, El Salvador, Falkland Is Full-time

Remote, Latin America (minimum 4-hour overlap with US Eastern hours) | Engineering | Reports to: Technical Lead Time Doctor is hiring a Senior DevOps Engineer to run and scale the cloud…

3h ago DevOps and Sysadmin

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.