caferemote
ICF

Applied AI Engineer — Global Health & AI (REMOTE ROLE)

Remote United States Full-time $98K – $167K / year Posted 3 days ago
Apply now
Work from
United States
Contract
Full-time
Salary
$98K – $167K / year
Posted
17 November 2026
Apply by
16 January 2027

ICF's Global Health and Development (GHD) line of business, part of the Health, People, and Human Services (HPHS) Group, is seeking an Applied AI Engineer to build frontier-model systems for various global health and survey programs. This role will support the development of AI-enabled tools that draft survey reports, let researchers and policymakers analyze data in natural language, translate questionnaires into low-resource languages, and support interviewers and data quality in the field.

Applied AI Engineer — Global Health & AI

No tool is adopted unless it matches or beats the expert-led process it replaces. You will build the prompting, agent, and pipeline layer across the program. You will also build the evaluation harnesses that show whether each tool actually works, judged against ground truth produced by some of the most experienced survey methodologists in the world.

This position can be remote within the United States, with occasional travel.

It is contingent upon award of program funding.

Responsibilities

  • Design and build LLM pipelines and agents for survey workflows, including:
    • an AI-assisted data-to-report pipeline
    • natural-language analysis of survey data
    • multilingual questionnaire translation
    • field support tools for interviewers and supervisors
  • Build evaluation harnesses as first-class deliverables. Work with the Technical Lead and survey experts to define acceptance criteria before the work is judged. Build test sets from expert-produced ground truth and run the non-inferiority comparisons that decide whether a tool moves forward.
  • Route work across models based on reasoning complexity, volume, cost, latency, and data-residency requirements.
  • Manage inference cost by tracking token usage, context limits, prompt caching, and batch processing, and account for these operating costs in model-selection decisions.
  • Connect models to data services and to the applications built by full stack developers.
  • Use agentic coding tools to produce software from clear specifications, then review, test, and own the resulting code.
  • Monitor production systems, conduct disciplined error analysis, and report positive and negative results.
  • Document methods and results for public release, including negative results. Help transfer tools to partner-country institutions so they can run them on their own.

Minimum Required Experience

  • Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent years experience)
  • Minimum 4 years of professional software development experience, including building LLM-powered systems that real users relied on in production
  • U.S. citizenship is required by federal government contract

Additional Required Skills and Experience

  • Proficiency in Python or another modern programming language (e.g., JavaScript/TypeScript, Go) for back-end and AI application development
  • Hands-on experience building with frontier-model APIs (from any provider, or through any cloud platform), including tool use and retrieval-augmented generation
  • Demonstrated experience designing LLM evaluations, including test-set construction, automated and human grading, regression testing, and ship/no-ship decisions.
  • Working knowledge of LLM cost, latency, and model-selection trade-offs
  • Experience building and deploying on a major cloud platform (e.g., AWS, Azure, or Google Cloud)
  • Demonstrated experience using agentic coding tools, such as Claude Code, OpenAI Codex, Cursor, Antigravity, or GitHub Copilot agent mode, to specify, review, test, and take ownership of production code.
  • Experience with agent frameworks and AI evaluation tooling.

Nice to have

  • Experience with tasks where ground truth came from subject matter experts (for example, statisticians, clinicians, scientists, or methodologists)
  • Experience with grounded generation over structured or tabular data, or with LLM-assisted statistical analysis
  • Experience with multilingual or low-resource-language NLP, translation, or speech
  • Experience deploying open-weight models
  • Experience with sensitive or regulated data, such as health data or human-subjects research
  • Familiarity with model governance, monitoring, and responsible AI practice
  • Experience in global health, international development, or low- and middle-income country settings
  • Public work such as open-source contributions, published evaluations, or technical writing about systems you built undefined

Professional Skills

  • Explains AI trade-offs clearly to technical and non-technical audiences, including funders, survey experts, and partner-government staff
  • Collaborates effectively across disciplines, cultures, time zones, and organizational levels while treating domain experts as the source of truth
  • Communicates uncertainty, limitations, and negative results candidly.Self-motivated
  • Finds ways to add value without a lot of direct supervision

Salary

- There are multiple factors that are considered in determining final pay for a position, including, but not limited to, relevant work experience, skills, certifications and competencies that align to the specified role, geographic location, education and certifications as well as contract provisions regarding labor categories that are specific to the position.

The pay range for this position based on full-time employment is:

$98,614.00 - $167,644.00Nationwide Remote Office (US99)

Indeed

GHDAI

Bot and Third-Party Applications

Please note that this application must be submitted directly by the applicant for consideration. Failure to do so may result in the application being excluded for consideration. Applicants needing an accommodation for disability or religious purposes in connection with the application process should contact for assistance.

Working at ICF

ICF is a global advisory and technology services provider, but we’re not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future.

We can only solve the world's toughest challenges by building a workplace that allows everyone to thrive. We are an equal opportunity employer.Together, our employees are empowered to share theirexpertiseand collaborate with others to achieve personal and professional goals. For more information, please read our EEOpolicy.

We will consider for employment qualified applicants with arrest and conviction records.

Reasonable Accommodations are available, including, but not limited to, for disabled veterans, individuals with disabilities, and individuals withsincerely heldreligious beliefs, in all phases of the application and employment process. To requestan accommodation,please email and we will be happy toassist. All information you provide will be kept confidential and will be used only to the extentrequiredto provide needed reasonable accommodations.

Read more about workplace discrimination rightsor our benefit offerings which are included in the Transparency in (Benefits) CoverageAct.

Candidate AI Usage Policy

At ICF, we are committed to ensuring a fair interview process for all candidates based on their own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) tools to generate orassistwith responses during interviews (whether in-person or virtual) is notpermitted. This policy is in place tomaintainthe integrity and authenticity of the interview process.

However, we understand that some candidates may require accommodation that involves the use of AI. Ifsuch anaccommodation is needed, candidates are instructed to contact us in advance at. Weare dedicated to providingthe necessary support to ensure that all candidates have an equal opportunity to succeed.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from ICF

View company →

Salesforce QA Tester DHS Public Trust- Remote

ICF
Remote United States Full-time $67K – $114K / year

Job Description * We are open to supporting 100% remote work anywhere within the continental US * The Salesforce Quality Assurance Tester (QA Tester) is…

18h ago Quality Assurance

Email Marketing Specialist

ICF
Remote United States Full-time $61K – $104K / year

The Work ICF is looking for a detail-oriented Email Marketing Specialist to join our digital communications team supporting federal health communications…

20h ago Sales and Marketing

Scientific Working Groups and Committees (SWC) Coordinator - ON-CALL

ICF
Remote United States Part-time $61K – $104K / year

The SWG-C Coordinator will work with a multi-disciplinary team overseeing the activities under an NIH contract to support a large research consortium. The…

20h ago Product

ServiceNow Developer (EAM, HAM, SAM)) - Remote

ICF
Remote United States Full-time $98K – $167K / year

ICF is seeking a Senior ServiceNow Developer to support a public health agency client within the Office of the Chief Information Officer (OCIO). The ideal…

yesterday Software Development

Similar remote jobs

Browse all →

Senior BI/DW Developer

Nextpower
Remote India Full-time

Job Description: BI/DW Architect (Finance Analytics & Insights) Position Summary The BI/DW Architect (Finance Analytics & Insights) is a strategic leader within the Global Controllership…

2h ago Data

Senior Analytics Solutions Lead – Power BI & Fabric

Cooper Equipment Rentals Limited
Remote Canada Full-time CAD 110K – CAD 130K / year

Build your Career at Cooper Equipment Rentals Please note, to be considered for this position applicants should currently be residing in Canada and legally entitled to work. Why Work with…

3h ago Data

ServiceNow Business Analyst

LIGHTFEATHER IO LLC
Remote United States Full-time $110K – $130K / year

LightFeather is seeking a Senior ServiceNow Business Analyst to lead the requirements gathering and process design for our federal agency clients. In this role, you will act as the critical…

3h ago Data

Senior Data Migration Specialist

WELLSTAR
Remote Canada Full-time CAD 75K – CAD 95K / year

Who we are At WELLSTAR , we are committed to reshaping Canadian healthcare by leveraging technology to address the administrative burdens that pull physicians away from their true calling,…

3h ago Data

Risk Adjustment Operations Senior Project Analyst

Datavant
Remote United States Full-time $103K – $121K / year

Datavant is the data collaboration platform trusted for healthcare. Guided by our mission to make the world’s health data secure, accessible and actionable, we provide critical data…

3h ago Data

Data Scientist

Timeleft
Remote Albania, Andorra, Austria, Belarus, Belgium, Bosnia and Herzegovina, Bulgaria, Croatia, Cyprus, Czechia, Denmark, Estonia, Faroe Islands, Finland, France, Germany, Gibraltar, Greece, Guernsey, Holy See (Vatican City State), Hungary, Iceland, Ireland, Full-time

⌘Role Overview The Data Scientist is the first hire on the team whose job is to put machine learning into production , not just into a notebook. You'll build models that power product and…

4h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.