caferemote
WekaIO

Principal Product Manager, Augmented Memory Grid (AMG)

Remote United States Full-time Lead Posted 6 days ago
Apply now
Work from
United States
Contract
Full-time
Experience
Lead
Posted
14 November 2026
Apply by
13 January 2027

WEKA is looking for a Product Manager to own the roadmap and go-to-market for Augmented Memory Grid (AMG), part of the NeuralMesh platform. You will work directly with engineering, GPU/inference partners (NVIDIA, hyperscalers, GPU clouds), and enterprise customers running large-scale LLM inference to define what AMG needs to do next.

WEKA is architecting a new approach to the enterprise data stack built for the age of reasoning. NeuralMesh by WEKA sets the standard for agentic AI data infrastructure with a cloud- and AI-native software solution that can be deployed anywhere. It transforms legacy data silos into data pipelines that dramatically increase GPU utilization and make AI model training and inference, machine learning, and other compute-intensive workloads run faster, work more efficiently, and consume less energy.

WEKA is a pre-IPO, growth-stage company on a hyper-growth trajectory. We’ve raised $375M in capital with dozens of world-class venture capital and strategic investors. We help the world’s largest and most innovative enterprises and research organizations, including 12 of the Fortune 50, achieve discoveries, insights, and business outcomes faster and more sustainably. We’re passionate about solving our customers’ most complex data challenges to accelerate intelligent innovation and business value. If you share our passion, we invite you to join us on this exciting journey.

About the role

This is a deeply technical PM role sitting at the intersection of AI inference infrastructure, high-performance networking, and enterprise storage.

Responsibilities

  • Own the AMG product roadmap: KV-cache/prefix-cache offload, memory tiering, and integration with inference engines and orchestration layers (vLLM, NVIDIA Triton/TensorRT-LLM/NIM, Kubernetes-based serving).
  • Partner with engineering to define architecture trade-offs across GPU memory, networking (RDMA, GPUDirect, NVMe-oF), and distributed storage — translating inference performance bottlenecks (time-to-first-token, throughput, context length) into product requirements.
  • Work directly with enterprise customers and GPU cloud partners: Nebius, CoreWeave, TogetherAI, etc., running production inference workloads to gather requirements, validate benchmarks, and prioritize features that reduce cost-per-token and improve SLAs at scale.
  • Partner with NVIDIA and other silicon/inference-stack partners on joint roadmap and certification work.
  • Define and track benchmarks (TTFT, throughput, cache hit rate) that demonstrate AMG's value versus standard GPU-memory-only inference.
  • Support sales and field teams with technical positioning, competitive differentiation, and enterprise deal support.

Requirements

  • Inference ecosystem depth: hands-on product or engineering experience with LLM inference serving — vLLM, NVIDIA Triton/TensorRT-LLM/NIM, Ray Serve, or comparable — and fluency in concepts like KV-cache, prefix/context caching, quantization, and batching strategies.
  • Model & systems familiarity: working knowledge of how modern LLMs are served in production (context windows, multi-tenant serving, GPU scheduling) well enough to translate model-level constraints into infrastructure requirements.
  • Networking/infrastructure fluency: comfort with the fundamentals of high-performance networking and distributed systems — RDMA, GPUDirect Storage, NVMe-oF, or equivalent — and how they affect inference performance.
  • Enterprise customer experience: track record working directly with large enterprise accounts — requirements gathering, production deployments, SLAs — not solely self-serve/PLG products.
  • 10+ years of product management experience, ideally with some portion in infrastructure, ML platforms, or developer-facing technical products.

Nice to have

  • Prior experience at a GPU cloud, inference platform, or AI infrastructure startup.
  • Familiarity with storage systems (parallel/distributed file systems, object storage) in AI/ML pipelines.
  • Experience partnering directly with NVIDIA or other accelerator/silicon vendors.

The WEKA Way

  • We are Accountable: We take full ownership, always–even when things don’t go as planned. We lead with integrity, show up with responsibility & ownership, and hold ourselves and each other to the highest standards.
  • We are Brave: We question the status quo, push boundaries, and take smart risks when needed. We welcome challenges and embrace debates as opportunities for growth, turning courage into fuel for innovation.
  • We are Collaborative: True collaboration isn’t only about working together. It’s about lifting one another up to succeed collectively. We are team-oriented and communicate with empathy and respect. We challenge each other and conduct positive conflict resolution. We are being transparent about our goals and results. And together, we’re unstoppable.
  • We are Customer Centric: Our customers are at the heart of everything we do. We actively listen and prioritize the success of our customers, and every decision we make is driven by how we can better serve, support, and empower them to succeed. When our customers win, we win.

Concerned that you don’t meet every qualification above?

Studies have shown that women and people of color may be less likely to apply for jobs if they don’t meet every qualification specified. At WEKA, we are committed to building a diverse, inclusive and authentic workplace. If you are excited about this position but are concerned that your past work experience doesn’t match up perfectly with the job description, we encourage you to apply anyway – you may be just the right candidate for this or other roles at WEKA.

WEKA is an equal opportunity employer that prohibits discrimination and harassment of any kind. We provide equal opportunities to all employees and applicants for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Bring Your Expertise – and Your Passion

  • Leadership Skills: Strong leadership skills with a history of successfully leading cross-functional teams. Product Managers are expected to inspire and motivate team members to achieve ambitious goals while maintaining a collaborative and positive working environment. You understand how to influence without authority, and your recall of meaningful details supports verbal and written agility.
  • Strategic Vision: You are a strategic thinker who can develop and execute product strategies that align with market trends and customer needs, as well as think critically about existing strategies. You have a proven ability to translate strategic goals into actionable plans and deliver results.
  • Communication Skills: You have excellent communication and interpersonal skills, with the ability to articulate complex technical concepts to both technical and non-technical stakeholders. You are comfortable presenting product strategies and roadmaps to internal teams and external customers.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from WekaIO

View company →

Senior Product Manager - Appliance Experience

WekaIO
Remote United States Full-time $210K – $280K / year

WEKA is architecting a new approach to the enterprise data stack built for the age of reasoning. NeuralMesh by WEKA sets the standard for agentic AI data…

yesterday Product

Principal Solutions Architect, AI Ecosystem & Alliances

WekaIO
Remote United States Full-time

We are seeking a technically fluent Principal Solutions Architect to lead our strategic partnership strategy across the enterprise AI infrastructure ecosystem.…

yesterday Data

WEKA Data Platform Administrator (Remote US)

WekaIO
Remote United States Full-time

WEKA Data Platform Administrator Customer Success - Premium Services About the job WEKA is architecting a new approach to the enterprise data stack built for…

yesterday DevOps and Sysadmin

Senior Solution Architect, Applied AI

WekaIO
Remote United States Full-time

We are seeking a Tech Lead to lead our AI Inference team. In this role, you will bridge the gap between complex research and production-grade engineering,…

yesterday DevOps and Sysadmin

Similar remote jobs

Browse all →

Solution Delivery Architect - MF Storage

Ensono
Remote India Full-time

ABOUT US Ensono is a hybrid IT services provider that sees a world in transformation. We understand the world of business has become more complex, layered, and interdependent because…

1h ago DevOps and Sysadmin

Principal Technologist - 90335753 - Remote (US)

Amtrak
Remote United States Full-time $113K – $146K / year

Your success is a train ride away! As we move America’s workforce toward the future, Amtrak connects businesses and communities across the country. We employ more than 20,000 diverse,…

1h ago DevOps and Sysadmin

Senior Site Reliability Engineer (SRE)

LeoLabs
Remote United States Full-time $171K – $192K / year

Why LeoLabs ? At LeoLabs , we’re building the living map of activity in space. Through our proprietary global radar network and AI-enabled analytics platform, we collect millions of…

1h ago DevOps and Sysadmin

Software Engineer (PDLC Tooling + Automation)

Bloomerang
Remote Canada, United States Full-time $100K – $167K / year

At Bloomerang , we believe change happens on purpose. We champion the power and potential of nonprofits, igniting next-level impact with the team and technology built for purpose. Our…

1h ago DevOps and Sysadmin

Sr. Database Developer

Concept Plus
Remote United States Full-time

About Concept Plus Concept Plus is a mission-focused technology solutions provider that transforms IT concepts into impactful solutions for federal agencies. Headquartered in Fairfax, VA,…

4h ago DevOps and Sysadmin

Database Developer

Concept Plus
Remote United States Full-time

About Concept Plus Concept Plus is a mission-focused technology solutions provider that transforms IT concepts into impactful solutions for federal agencies. Headquartered in Fairfax, VA,…

5h ago DevOps and Sysadmin

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.