caferemote
Welo Global

Project Lion - Senior Prompt Engineer - Portugal (Remote, Part-Time)

Remote Portugal Contract Senior Posted 13 days ago
Apply now
Work from
Portugal
Contract
Contract
Experience
Senior
Posted
8 November 2026

We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to leverage prompt engineering techniques to maximize model performance.

Responsibilities

  • Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise Automated Prompt Optimization (APO) tool, review the outputs, and flag when the APO reaches deadlocks or plateaus.
  • Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts.
  • Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.
  • Run prompt versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.
  • Draft technical launch readiness justifications (Launch Certification Documentation) for final.

Requirements

  • Language Skills: Native fluency in Portuguese and fluent in English.
  • Location: Must be based in Portugal.
  • Education: Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • Prompt Engineering & AI Expertise: At least 4 years' experience as Prompt Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning.
  • Data Analysis: Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
  • Technical Agility: Ability to quickly learn and master proprietary tools with minimal supervision.
  • Communication: Excellent verbal and written communication skills.

Optional / Preferred Skills

  • Familiarity with enterprise-grade LLM interfaces like the Goose API.
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering.
  • Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows.
  • Linguistic expertise, including an understanding of semantics and logic.

Salary

Additional Information

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Welo Global

View company →

English to Belarusian Review Lead for UI, Marketing & Product Content

Welo Global
Remote Argentina, Australia, Austria, Belgium, Brazil, Bulgaria, Canada, Chile, China, Colombia, Costa Rica, Croatia, Czechia, Denmark, Egypt, El Salvador, Finland, France, Germany, Ghana, Greece, Guatemala, Hong Kong, Hungary, India, Indonesia, Ireland, Is Contract

About Welo Global Welo Global is a leader in multilingual AI, technology, and content solutions serving over 2,000 clients in 300 languages. The company…

1h ago Quality Assurance

Punjabi Music Content Specialist (India)

Welo Global
Remote India Contract INR 650K / year

Welo Data is looking for someone with a genuine passion for music and the artists behind it, across genres. This is an entry level role suited to a candidate…

4h ago Content Creator

Finnish Tech Linguistic Tester

Welo Global
Remote Anywhere Full-time

As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow…

13h ago Quality Assurance

Alpheratz Project - Valencia (Spain) Translation Quality Rater

Welo Global
Remote Spain Contract $21 / hour

Description Are you detail-oriented and passionate about language quality? We are looking for translators to join an ongoing project, helping ensure accuracy,…

22h ago Quality Assurance

Similar remote jobs

Browse all →

Systems Analyst

Koniag Government Services
Remote United States Full-time $110K – $145K / year

Applications for this position will be accepted through 11/15/26 Koniag IT Systems, LLC a Koniag Government Services company, is seeking a Systems Analyst to support KITS and our government…

1h ago Data

Sr Data Analyst

Alignment Health
Remote United States Full-time $113K – $169K / year

Alignment Health is breaking the mold in conventional health care, committed to serving seniors and those who need it most: the chronically ill and frail. It takes an entire team of…

1h ago Data

Senior Analyst, Revenue Management

OPENLANE
Remote United States Full-time $90K – $110K / year

Who We Are: At OPENLANE we make wholesale easy so our customers can be more successful. We’re a technology company building the world’s most advanced—and uncomplicated—digital…

1h ago Data

Manager, Data Product Management

wex
Remote United States Full-time $133K – $159K / year

About the Team/Role WEX Data & Analytics is building the data products and platform capabilities that help employers, partners, and operators access accurate, actionable information. As we…

1h ago Data

Centralized Study Specialist I, Remote US

Fortrea
Remote United States Full-time $60K – $80K / year

Job Responsibilities: Manage clinical systems. Manage study documents and support eTMF management. Maintain study databases (CTMS, IWRS, EDC, etc.) Track and follow up with CRAs for…

1h ago Data

F-35 Data Analyst Mid - 31190 (Arlington, VA, Virginia, United States)

HII
Remote United States Full-time $90K – $110K / year

Requisition Number: 31190 Required Travel: 0 - 10% Employment Type: Full Time/Salaried/Exempt Anticipated Salary Range: $90,000.00 - $110,000.00 Security Clearance: Ability to Obtain Level…

1h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.