About the Company
Mindrift is a platform that connects specialists with AI projects from major tech innovators. Their mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe.
Key Responsibilities
- Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
- Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements.
- Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior.
- Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
- Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Requirements
- At least 1 year of relevant experience in data analysis, AI automation, data engineering, or software development is desirable.
- Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
- Proficient in Python web scraping: Build reliable scraping scripts using BeautifulSoup, Selenium (or equivalents) for multi-level sites, dynamic JS content (infinite scroll, AJAX), and API endpoints via provided proxy.
- Demonstrate data extraction expertise: Navigate complex hierarchical structures (regions → companies → details), handling archived pages and varied HTML formats.
- Data processing skills: Clean, normalize, and validate scraped data; deliver high-quality datasets in well-structured formats (CSV, JSON, Google Sheets) with clear, consistent presentation.
- Hands-on experience with LLMs and AI frameworks to enhance automation and problem-solving.
- Strong attention to detail and commitment to data accuracy.
- Self-directed work ethic with ability to troubleshoot independently.
- Proficient in English (upper-intermediate or above).
Benefits
- Get paid for your expertise, with rates that can go up to $32/hour depending on your skills, experience, and project needs.
- Work fully remote on your own schedule with just a laptop and stable internet connection.
- Gain hands-on experience in a unique hybrid environment where human expertise and AI agents collaborate seamlessly — a distinctive skill set in a rapidly growing field.
- Participate in performance-based bonus programs that reward high-quality work and consistent delivery.