Senior Backend / Automation Engineer
Description
Senior Backend / Automation Engineer — Data Intelligence Platform
Qail Labs Inc | Remote | Contract-to-hire We're building a social media intelligence platform that collects and analyzes public content across audience segments in real time. We need an engineer who can own the infrastructure, data collection pipeline, and backend.
What you'll do Build and maintain the data collection infrastructure: provisioning servers, managing browser-based scrapers, and automating data pipelines at scale. Design the backend API, data storage layer, and integrate with the Next.js dashboard. Monitor system health and scale from prototype to production.
Must have Python (FastAPI or similar async framework) Browser automation at scale (Playwright, Puppeteer, or Selenium) Residential proxy management — rotation strategies, sticky sessions, IP health monitoring Web scraping at production scale — handling rate limits, retries, and data quality solving service integration (2, CapMonster, or similar) Docker / Docker Compose on bare metal or cloud (Hetzner, AWS, etc.) PostgreSQL and Redis
Strong plus LLM API integration (OpenAI, Gemini, DeepSeek) Next.js / React Experience with social media data collection Disposable email/phone verification pipelines
How we work Small team, milestone-based delivery with live demos. You'll work directly with the founder. We move fast and ship weekly.
Compensation Competitive, based on experience. Contract starting immediately with path to ongoing engagement.
Skills
Want AI to find more roles like this?
Upload your CV once. Get matched to relevant assignments automatically.