Senior Python Data Scraping Engineer (Freelance)

About the role

Mindrift is seeking a Senior Python Data Scraping Engineer to join the Tendem project on a part‑time remote freelance basis. You will act as an AI Pilot, collaborating with Tendem Agents to design, execute, and validate complex web‑scraping workflows that feed our hybrid AI‑human system.

Key responsibilities

• Own end‑to‑end data extraction workflows across complex websites, delivering accurate, structured datasets.
• Leverage internal tools (Apify, OpenRouter) and custom Python scripts to accelerate collection, validation, and task execution.
• Handle dynamic, JavaScript‑rendered content and adapt to changing site behavior.
• Enforce data quality through validation checks, cross‑source consistency, and formatting specifications.
• Scale scraping operations using batching or parallelisation, monitor failures, and maintain stability against minor site changes.

Required profile

• 5+ years of experience in data engineering, web scraping, automation, or software development.
• Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science or related field (optional).
• Strong foundation in scripting, automation, and AI‑assisted workflows.
• Methodical, detail‑oriented, and able to work independently.

Required skills

• Python web scraping (BeautifulSoup, Selenium or similar) including handling of JS, AJAX, infinite scroll.
• Experience with proxies and API extraction.
• Data cleaning, normalization, and validation delivering CSV, JSON or Google Sheets.
• Familiarity with Apify and OpenRouter platforms.
• Ability to work with large language models (LLMs) for workflow automation.

What we offer

• Part‑time remote freelance engagement.
• Opportunity to work on cutting‑edge AI‑human hybrid projects.