This job is no longer available
This job expired on 15/10/2026. It no longer accepts applications.
Senior Python Engineer - AI Coding Agent Evaluation (Freelance)
Mindrift
Job description
About the role
We are looking for a senior Python engineer to help build a high‑quality dataset for evaluating AI coding agents. You will design realistic developer environments and craft challenging tasks that test the limits of current models.
Key responsibilities
- Create virtual company environments with codebases, infrastructure, tickets, documentation, and conversation histories.
- Design tasks from intermediate states, write clear prompts, define success criteria, and ensure they are solvable by an AI agent.
- Develop functional and integration tests that accept all correct solutions while rejecting incorrect ones.
- Iterate on tasks and tests based on QA feedback, reviewing agent outputs and refining evaluation criteria.
Required profile
- 8+ years of professional software development experience.
- Strong command of English (minimum B2 level).
- Hands‑on experience with Python (FastAPI) and JavaScript/TypeScript (React).
- Familiarity with Docker, PostgreSQL, Kafka, and Redis.
- Proven ability to write comprehensive tests (functional, integration).
Required skills
- Python
- FastAPI
- JavaScript
- TypeScript
- React
- Docker
- PostgreSQL
- Kafka
- Redis
- Testing (functional & integration)
What we offer
- Project‑based freelance engagement with flexible scheduling.
- Compensation up to $150 per hour, based on experience and pace.
- Opportunity to work on cutting‑edge AI evaluation challenges.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Algeria.
Salaries by job title
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Mindrift
Related job offers
-
Senior Software Engineer, Native Mobile (International)
Coinbase -
Stage développement d'applications embarquées Linux/Android automobile
Fibonova Béjaïa -
Founder in Residence - Short-Term Rental AI
The Flex Annaba -
Ingénieur Stockage et Virtualisation
ABM Algeria Business Multimedia Algiers -
Senior Software Engineer - AI Operating System for Short-Term Rentals
The Flex Annaba