caferemote
MetroSys

AI Infrastructure Solutions Architect

Remote United States Contract $100 – $125 / hour Posted 1h ago
Apply now
Work from
United States
Contract
Contract
Salary
$100 – $125 / hour
Posted
17 November 2026
Apply by
16 January 2027

MetroSys is seeking a highly experienced Senior AI Infrastructure Solutions Architect to support the design, planning, and implementation of advanced artificial intelligence computing environments for enterprise organizations.

About the role

This position requires a technical leader with extensive experience in GPU-accelerated infrastructure, high-performance computing (HPC), enterprise networking, storage architecture, and AI platform integration.

The ideal candidate will combine deep infrastructure engineering expertise with the ability to advise customers on complex technology investments, develop scalable solutions, and translate business requirements into practical architecture designs.

This individual will collaborate with engineering teams, technical stakeholders, and business leadership to develop infrastructure solutions capable of supporting demanding AI workloads, including large language models (LLMs), machine learning, model training, and enterprise inference applications.

The role requires both hands-on technical knowledge and the ability to lead architectural discussions with senior IT executives.

Responsibilities

Enterprise AI Infrastructure Architecture

  • Design enterprise-scale infrastructure environments supporting AI, machine learning, and high-performance computing workloads.
  • Develop architecture solutions integrating GPU compute platforms, high-throughput networking, enterprise storage, and workload orchestration technologies.
  • Evaluate infrastructure requirements based on application performance, scalability, resource utilization, and operational costs.
  • Produce technical architecture documentation, infrastructure diagrams, hardware specifications, and implementation plans.
  • Lead infrastructure discovery sessions and technical workshops to identify customer requirements and recommend appropriate solutions.
  • Design solutions supporting on-premises, private cloud, and hybrid AI computing environments.
  • Assess existing data center infrastructure and recommend upgrades necessary to support GPU-intensive computing.

GPU Computing and Accelerated Infrastructure

  • Architect solutions utilizing NVIDIA accelerated computing technologies and alternative GPU platforms.
  • Provide technical guidance on NVIDIA DGX, HGX, MGX, and enterprise GPU computing environments.
  • Evaluate NVIDIA Hopper and Blackwell architectures for AI training and inference requirements.
  • Design scalable GPU clusters supporting distributed computing and resource-intensive AI applications.
  • Support GPU platform sizing, performance analysis, capacity planning, and infrastructure optimization.
  • Evaluate AMD Instinct and Intel accelerator technologies when appropriate for customer workloads.
  • Assess infrastructure dependencies including rack density, power distribution, cooling, and physical data center capacity.

High-Performance Networking and Storage

  • Develop high-bandwidth network architectures designed for distributed GPU processing and AI applications.
  • Design and evaluate InfiniBand, RoCE, and high-speed Ethernet connectivity solutions.
  • Integrate high-performance storage platforms supporting large-scale data processing and model training.
  • Evaluate NVMe-based storage, parallel file systems, and distributed storage technologies.
  • Identify network and storage bottlenecks that could affect AI workload performance.
  • Collaborate with network, storage, and data center engineering teams to ensure infrastructure interoperability.

AI Platforms, Automation, and Workload Management

  • Design infrastructure platforms supporting containerized AI applications and distributed computing workloads.
  • Implement architectural solutions involving Kubernetes, Red Hat OpenShift AI, and Linux-based computing environments.
  • Evaluate workload management platforms including NVIDIA Run:ai, Slurm, and other GPU scheduling technologies.
  • Provide architectural guidance for NVIDIA AI Enterprise, NVIDIA NIM, NVIDIA Mission Control, and related AI infrastructure software.
  • Support integration of MLOps platforms used for model development, training, deployment, monitoring, and lifecycle management.
  • Develop infrastructure automation strategies to improve deployment consistency, operational efficiency, and resource utilization.
  • Assist with capacity planning and performance optimization for AI training and inference workloads.

Infrastructure Security and Governance

  • Incorporate enterprise security requirements into AI infrastructure architecture.
  • Design secure environments supporting sensitive datasets, proprietary AI models, and regulated workloads.
  • Implement architectural controls supporting workload isolation, identity management, access control, and infrastructure monitoring.
  • Evaluate security considerations associated with shared GPU resources and multi-tenant computing environments.
  • Collaborate with cybersecurity teams to align infrastructure solutions with applicable organizational and regulatory requirements.
  • Provide guidance on infrastructure logging, observability, auditability, and operational resilience.

Technical Consulting and Solution Development

  • Serve as a senior technical advisor during customer discovery, solution planning, and architecture engagements.
  • Translate complex business and technical requirements into actionable infrastructure recommendations.
  • Work with technical sales and delivery teams to develop solution designs, equipment requirements, implementation strategies, and project estimates.
  • Present proposed architectures to technical teams, IT leadership, and executive stakeholders.
  • Evaluate competing technology solutions and provide objective recommendations based on performance, cost, and business requirements.
  • Develop reusable technical documentation, architecture standards, and solution frameworks.
  • Provide technical leadership and mentoring to infrastructure engineers and architects.
  • Maintain awareness of emerging AI infrastructure technologies and evolving industry architecture practices.

Requirements

  • 10+ years of experience in enterprise infrastructure architecture, solutions engineering, technical consulting, or related disciplines.
  • Significant experience designing complex data center or high-performance computing environments.
  • Strong knowledge of NVIDIA GPU computing technologies and enterprise AI infrastructure.
  • Experience with accelerated computing platforms, GPU cluster architecture, and infrastructure sizing.
  • Advanced understanding of enterprise networking, including high-speed Ethernet, InfiniBand, or RoCE.
  • Experience designing enterprise storage architectures for high-throughput and performance-sensitive workloads.
  • Strong knowledge of Linux operating systems, virtualization, containerization, and Kubernetes.
  • Familiarity with AI infrastructure software, GPU orchestration, and workload scheduling technologies.
  • Experience producing high-level designs, detailed technical specifications, and infrastructure implementation documentation.
  • Demonstrated ability to lead customer-facing technical discussions and communicate complex solutions to senior stakeholders.
  • Strong understanding of infrastructure scalability, availability, performance, and security principles.
  • Ability to collaborate across compute, storage, networking, security, and application engineering teams.

Nice to have

  • Experience with NVIDIA DGX, HGX, MGX, or comparable accelerated computing platforms.
  • Familiarity with NVIDIA AI Enterprise, NIM, Run:ai, Mission Control, and related technologies.
  • Experience with AMD Instinct GPU platforms or other accelerator architectures.
  • Knowledge of distributed AI training, inference optimization, and large language model infrastructure requirements.
  • Experience with Red Hat OpenShift AI or other enterprise Kubernetes environments.
  • Familiarity with Slurm and GPU resource scheduling platforms.
  • Experience supporting enterprise AI infrastructure deployments in regulated environments.
  • Understanding of NIST, FedRAMP, CMMC, or comparable security frameworks.
  • Experience with GPU-dense data center infrastructure, including power and cooling considerations.
  • Python scripting or infrastructure automation experience.
  • Relevant NVIDIA, cloud architecture, Linux, Kubernetes, or enterprise infrastructure certifications.
  • Experience supporting technical pre-sales engagements, solution development, or enterprise consulting initiatives.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from MetroSys

View company →

OT/SCADA Deployment Engineer

MetroSys
Remote United States Contract

Position Overview MetroSys is seeking an experienced OT/SCADA Deployment Engineer to support a large-scale rollout of the Inductive Automation Ignition SCADA…

20h ago DevOps and Sysadmin

Similar remote jobs

Browse all →

IT Solutions Architect (Specialty Microsoft Cloud)

VC3
Remote Canada Full-time

At VC3 , we don’t just solve IT problems — we own them. We serve hundreds of municipalities and organizations across the United States and Canada, bringing IT to the people who need it…

1h ago DevOps and Sysadmin

Senior Bioinformatics & Genomics Data System Engineer

Natera
Remote United States Full-time $113K – $142K / year

As a Senior Bioinformatics & Genomics Data System Engineer of our Data Science Production Engineering (DSPE) department, you will be a key member in the DSPE DevOps team, to design,…

2h ago DevOps and Sysadmin

Analyst II, IT Operations

Ensemble Health Partners
Remote India Full-time

Thank you for considering a career at Ensemble Health Partners India! Ensemble Health Partners - The single solution for a frictionless revenue cycle with the purpose of redefining the…

2h ago DevOps and Sysadmin

Director of Engineering Productivity and Operations

Matillion
Remote United Kingdom Full-time £141K – £211K / year

Are you ready to shape the future of data? Matillion is the company behind Maia, the AI Data Automation platform. In the AI economy, demand for data is exploding. Manual data engineering…

3h ago DevOps and Sysadmin

Technical Product Manager - DevEx

Wave Mobile Money
Remote Burkina Faso, Canada, Côte d'Ivoire, Ghana, Kenya, Senegal, Spain, United Kingdom, United States Full-time $237K / year

Our mission We're making Africa the first cashless continent. In 2017, over half the population in Sub-Saharan Africa had no bank account. That's for good reason—the fees are too high,…

3h ago DevOps and Sysadmin

Staff Data Engineer, Analytics

Afresh
Remote United States Full-time

Afresh , the AI platform for grocery, began by tackling the most complex problem in the industry: fresh, and has evolved into the core AI platform for grocers. By leveraging proprietary AI…

3h ago DevOps and Sysadmin

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.