Freelance Agent Evaluation Engineer

hace 1 semana

Buenos Aires, Buenos Aires C.F., Argentina Mindrift A tiempo completo

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

What this opportunity involves

While each project involves unique tasks, contributors may:

  • Create structured test cases that simulate complex human workflows
  • Define gold-standard behavior and scoring logic to evaluate agent actions
  • Analyze agent logs, failure modes, and decision paths
  • Work with code repositories and test frameworks to validate your scenarios
  • Iterate on prompts, instructions, and test cases to improve clarity and difficulty
  • Ensure that scenarios are production-ready, easy to run, and reusable

What we look for

This opportunity is a good fit for software engineers, open to part-time, non-permanent projects. Ideally, contributors will have: 

  • 3+ of software development experience with strong Python focus
  • Experience with Git and code repositories
  • Comfortable with structured formats like JSON/YAML for scenario description
  • Understanding core LLM limitations (hallucinations, bias, context limits) and how these affect evaluation design
  • Familiarity with Docker
  • English proficiency - B2

How it works

Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid

Project time expectations

Tasks for this project are estimated to take 6-10 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Payment

  • Paid contributions, with rates up to $17/hour*
  • Fixed project rate or individual rates, depending on the project
  • Some projects include incentive payments

*Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.

  • Evaluation Scenario Writer

    hace 48 segundos

    Buenos Aires, Buenos Aires C.F., Argentina Mindrift A tiempo completo

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English.At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What we...

  • Freelance Economic Analyst

    hace 1 minuto

    Buenos Aires, Buenos Aires C.F., Argentina Mindrift A tiempo completo

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI.What...

  • Freelance Electrical Engineer

    hace 2 minutos

    Buenos Aires, Buenos Aires C.F., Argentina Mindrift A tiempo completo

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English.At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI.What we doThe...

  • Freelance Mechanical Engineer

    hace 59 segundos

    Buenos Aires, Buenos Aires C.F., Argentina Mindrift A tiempo completo

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English.At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI.What we doThe...

  • Freelance Senior Python Developer

    hace 1 semana

    Buenos Aires, Buenos Aires C.F., Argentina Mindrift A tiempo completo

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI...

  • Senior AI Software Engineer

    hace 2 minutos

    Buenos Aires, Buenos Aires C.F., Argentina Workana A tiempo completo

    Workana is the largest remote work platform for talents in Latin America. Our new segment, Workana Premium, focuses on matching the most exceptional professionals with leading and innovative companies around the globe. Enjoy competitive compensation, dedicated support, and the flexibility of remote work within a dynamic environment that fosters collaboration...

  • Freelance Tax Accountant

    hace 1 minuto

    Buenos Aires, Buenos Aires C.F., Argentina Mindrift A tiempo completo

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI.What...

  • AI Engineer

    hace 1 minuto

    Buenos Aires, Buenos Aires C.F., Argentina MotionPoint A tiempo completo

    Marketfully.AI delivers AI-powered content intelligence that transforms how global brands create, adapt, and optimize multilingual marketing at scale. Unlike generic AI writing tools, Marketfully.AI combines cutting-edge GenAI with human expertise and deep localization capabilities to help enterprise marketing teams make smarter content decisions across...

  • Design Engineer

    hace 18 horas

    Buenos Aires, Buenos Aires C.F., Argentina Kirin A tiempo completo

    We are seeking a Design Engineer to maintain and update Italic's headless site. The ideal candidate will have experience with React Router and should be comfortable coding with AI tools.ResponsibilitiesMaintain and update our headless siteImplement new features and improvementsEnsure high code quality and performanceCollaborate with internal teams for...

  • Design Engineer

    hace 54 segundos

    Buenos Aires, Buenos Aires C.F., Argentina Kirin A tiempo completo

    We are seeking a Design Engineer to maintain and update Italic's headless site. The ideal candidate will have experience with React Router and should be comfortable coding with AI tools.ResponsibilitiesMaintain and update our headless siteImplement new features and improvementsEnsure high code quality and performanceCollaborate with internal teams for...