Freelance Data Scraping Engineer (Python)

Overview

Mindrift is seeking an experienced Python-focused data scraping engineer to contribute to the Tendem project. This freelance, part-time remote position sits inside a hybrid AI-plus-human workflow, where repetitive work is handled by Tendem Agents and you provide the technical judgment, subject-matter insight, and quality assurance needed to produce dependable outputs.

The opportunity is aimed at professionals who already know how to scrape, extract, and process web data in practical settings. You will work through Mindrift’s platform, which links domain experts to AI initiatives from leading technology companies, with the broader goal of improving Generative AI by bringing in real-world expertise.

This assignment is for a Tendem project and involves precise data extraction and processing work. You may use the tools provided by the platform, including Apify and OpenRouter, together with your own methods and scripts to complete tasks efficiently and accurately.

Responsibilities

• Run full-cycle extraction workflows across challenging websites and deliver complete, accurate, well-structured datasets.
• Use internal tooling such as Apify and OpenRouter, along with custom automation, to speed up collection, verification, and execution while meeting task requirements.
• Extract data reliably from dynamic sites, including pages that rely on JavaScript, AJAX, or infinite scrolling, and adjust methods when site behavior changes.
• Apply strict quality controls through validation, cross-checking across sources, formatting compliance, and careful review before submission.
• Handle larger scraping workloads by batching or parallelizing jobs, tracking failures, and keeping processes stable when websites make small structural changes.

Requirements

• At least 3 years of relevant experience in data engineering, web scraping, automation, or software development.
• Strong practical knowledge of Python web scraping tools such as BeautifulSoup and Selenium, plus experience with dynamic pages, APIs, and proxies.
• Ability to extract information from complicated page structures, including nested hierarchies, archived content, and inconsistent HTML.
• Good command of data cleaning, normalization, and validation, with experience producing structured outputs such as CSV, JSON, or Google Sheets.
• Experience working with LLMs and AI frameworks to improve automation and problem-solving.
• High attention to detail and a strong focus on accuracy.
• Independent working style with the ability to investigate and resolve issues on your own.
• English proficiency at upper-intermediate level (B2) or higher.
• A GitHub profile is considered an advantage.
• Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.

Compensation

You can earn up to the equivalent of USD 37 per hour on this project, depending on your contribution level and pace. Pay may differ across other projects on the platform based on their scope, complexity, and expertise needs.

Benefits

• Fully remote work with flexible scheduling, requiring only a laptop and a stable internet connection.
• Hands-on exposure to a hybrid workflow where human expertise works alongside AI agents.
• Access to performance-based bonus programs for strong and consistent output.

How to get started

Interested candidates can apply, complete the qualification process, and then join projects that match their technical background and preferred schedule. The role offers the chance to contribute to coding, automation, and AI-related work that supports real-world applications.