Lead Product Engineer

About Scrunch

Scrunch, a part of Sitecore, is dedicated to guiding brands into an AI-first era where large language models become the primary tools for discovering, understanding, and acting on important information.

As AI-powered search and conversational agents increasingly supplant traditional web searches and browsing, Scrunch supports marketing teams in reinventing how their offerings are discovered and presented on AI platforms such as ChatGPT, Claude, Gemini, among others. This transformation marks one of the most significant shifts in marketing since the internet's inception.

Currently, over 500 paying brands, including Fortune 500 companies like Lenovo, prominent brands such as Akamai and ADP, and emerging startups like Clerk, leverage the platform.

Role Overview

We seek a Lead Product Engineer to define and build how AI agents interact with our customers' websites. This role demands high ownership where you influence not just the execution but also the purpose behind what is created.

You will shape product behaviors when AI agents access pages, deliver end-to-end solutions across product features, CDN integrations, and AI traffic, moving from concepts to deployed products swiftly. Comfort with ambiguity and using modern AI tools to enhance productivity is essential.

Key Responsibilities

• Develop product features entirely from conception through to production, leveraging edge computing tools like Cloudflare Workers or similar.
• Identify AI-originating traffic and dynamically serve AI-tailored content pages real-time.
• Create seamless onboarding processes via integrations with customer CDNs and hosting providers like Cloudflare, Akamai, Fastly, and Vercel, ensuring safe deployments with instant rollback capabilities.
• Analyze how web pages render and the data AI agents consume, transforming these insights into product features.
• Study AI agent and crawler web access patterns, including technologies such as Web Bot Auth and verified bot signals.
• Provide customer-facing tools that reveal AI interaction details and what content was served promptly.
• Leverage AI-enhanced development tools (e.g., Claude, Codex, Cursor) to speed debugging and solution innovation.
• Make balanced architectural decisions that prioritize scalability and pragmatism over complexity.

Qualifications and Skills

• Extensive experience delivering full lifecycle product engineering for customer-facing features.
• Solid understanding of CDNs and HTTP mechanisms including caching, headers, and cache keys, sufficient to integrate robustly with customer environments.
• Strong product intuition enabling effective customer interaction, precise problem identification, and discerning feature prioritization.
• Genuine interest in AI agent and crawler web behaviors.
• History of thriving in dynamic, ownership-heavy roles.
• Comfortable making decisions with limited information and managing ambiguity effectively.
• Technical proficiency in writing production-grade Python code with test coverage, version control, and safe deployment practices.

Additional Preferred Experience

• Hands-on experience with browser automation tools like Playwright or Puppeteer.
• Familiarity with production deployment of edge functions including Cloudflare Workers, Fastly Compute, or Vercel Edge.
• Exposure to Web Bot Authentication, HTTP message signing, or bot management technologies.
• Background in frontend or full-stack development.
• Expertise in optimizing latency and cost efficiency per request.

Equal Opportunity Statement

Scrunch is committed to equal opportunity employment, welcoming applications from all individuals regardless of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability.