caferemote
Immiland Canada

Research Engineer, Large Language Models

Remote Canada Full-time Posted yesterday
Apply now
Work from
Canada
Contract
Full-time
Posted
19 November 2026
Apply by
18 January 2027

We are hiring a Research Engineer to help train our next generation of large language models. You will design, run, and scale training experiments on thousands of GPUs, and turn research ideas into production-grade models.

About the role

You will join a small team of researchers and engineers who own the full model lifecycle: data, pre-training, post-training, and evaluation. Research and engineering are not separate here: you will write the code, run the experiments, and shape the conclusions.

Responsibilities

Design and run large-scale pre-training and fine-tuning experiments, from small ablations to full training runs.

Study scaling laws to choose model size, data mix, and hyperparameters under a fixed compute budget.

Improve training efficiency through parallelism strategies (data, tensor, pipeline, FSDP), mixed precision, and custom CUDA or Triton kernels.

Diagnose and fix training instabilities such as loss spikes, divergence, and hardware failures.

Build and improve data pipelines, including filtering, deduplication, quality scoring, and dataset mixing.

Implement ideas from recent research papers and test whether they hold at scale.

Build evaluations that measure real model capabilities and track results rigorously.

Work closely with the alignment, infrastructure, and product teams, and share findings through clear write-ups.

Requirements

Required Qualifications – What We're Looking For

3+ years of hands-on experience training deep learning models, or a PhD in a related field (computer science, mathematics, or physics).

Strong Python skills and deep expertise in PyTorch or JAX.

Practical experience with Transformer architectures, including attention, tokenization, embeddings, and positional encodings.

Experience with distributed training on multi-node GPU clusters (FSDP, DeepSpeed, Megatron-LM, or similar).

Solid foundations in linear algebra, probability, statistics, and optimization.

Ability to read a research paper, implement it from scratch, and judge whether it works.

Rigorous experimental habits, including clean baselines, ablations, reproducible results, and experiment tracking.

Clear written and verbal communication skills, and comfort working in a fast-moving, ambiguous environment.

Preferred Qualifications – Nice to Have

Publications at top venues (NeurIPS, ICML, ICLR, ACL) or well-known open-source contributions.

Experience pre-training an LLM from scratch, at any scale.

Post-training experience, including supervised fine-tuning, RLHF, DPO, or other preference-optimization methods.

GPU performance work involving CUDA, Triton, FlashAttention-style kernels, and profiling.

Experience with efficient inference, including quantization, distillation, and optimized model serving.

Cluster and infrastructure experience with Slurm, Kubernetes, or cloud GPU platforms.

Large-scale data engineering experience (Spark, Ray, dataset curation for multilingual or domain-specific corpora).

Please apply only if your experience and technical background align with the required qualifications for this position.

Thank you for your interest!

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Immiland Canada

View company →

ESL Volunteer (English as a Second Language)

Immiland Canada
Remote Canada

Are you a recent grad looking for a volunteering opportunity to teach English as a second language to gain Canadian experience and get mentored practical…

3 days ago All Other Remote

Similar remote jobs

Browse all →

AI Safety Expert - Bilingual

mercor
Remote United States Contract $17 – $25 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

1h ago Data

Senior AI & Transformation Enablement Specialist

Datasite
Remote United States Full-time $83K – $141K / year

About us Datasite is the essential infrastructure for M&A. Also comprising Grata, Blueflame AI, and Sherpany, we help dealbreakers find opportunities, manage transactions, and make key…

2h ago Data

Business Analyst III Claims, DRG

Centene Corporation
Remote United States Full-time $70K – $126K / year

Position Purpose: Perform various analysis and interpretation to link business needs and objectives for assigned function. Key Details: Must be authorized to work in the U.S. without the…

2h ago Data

Functional Consultant – Epicor Kinetic (Operations & Supply Chain) – 100% Remote

TeccWeb
Remote United States Full-time

About Teccweb Teccweb is an Epicor Service Partner specializing in the implementation and optimization of Epicor Kinetic for mid-market manufacturers and distributors across North America.…

2h ago Data

Product Owner

Dev Partners
Remote Philippines Full-time

💻 We Are Hiring- Product Owner | 100% Remote We are seeking an experienced Product Owner to oversee and coordinate the ongoing maintenance, enhancement, and continuous improvement of an…

3h ago Data

Mechanical Engineer III

DLB Associates
Remote United States Full-time $105K – $135K / year

DLB Associates is a premier engineering and consulting firm specializing in innovative, mission-critical solutions across hyperscale data centers, advanced infrastructure, and…

3h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.