- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- 3 weeks ago
- Work mode
- Work from home
- Resume
- Required to apply
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About Pixalate
Pixalate is a global online trust and safety platform dedicated to safeguarding businesses, consumers, and children from deceptive, fraudulent, and non-compliant mobile, CTV apps, and websites. Our software and data have played a pivotal role in exposing significant criminal and illegal surveillance activities, with recognitions from organizations like UNICEF. Our diverse team, spanning lawyers, data scientists, engineers, and economists, is distributed worldwide.
Role Overview
As an AI Agent Engineer at Pixalate, you will be responsible for developing and maintaining AI agent system prompts and skills that define agent behavior when addressing real customer issues such as invalid traffic investigations and data analytics queries. This role involves rigorous engineering practices including version control, evaluation, and accountability for agent interactions deployed in production.
Responsibilities
- Create and sustain Claude-based skills and plugins shaping agent functionalities and responses.
- Develop agents capable of interactively seeking clarification and gathering information instead of relying on one-shot answers.
- Determine the appropriate content placement among skills, system prompts, and tools.
- Manage an evolving skill library aligned with product development.
- Lead system prompt ownership for client-facing agents, including IVT investigators, IQ Agent / Analytics MCP, and MRT MCP.
- Implement versioning practices with detailed change documentation.
- Diagnose agent malfunctions such as incorrect tool choices, hallucinated data, missing clarifications, and context handling issues.
- Set clear definitions of correctness per agent and build evaluation suites to measure performance against ground-truth customer scenario datasets.
- Prevent regressions from reaching customers through proactive testing.
- Design context strategies optimizing information visibility, order, and budget.
- Collaborate with engineering on MCP tool surfaces regarding tool availability, descriptions, and selection guidance.
- Optimize for accuracy, cost-efficiency, and response latency.
- Ensure safety measures against prompt injection, data leaks, and unsafe tool usage in customer-facing agents.
- Maintain accurate representation of Pixalate findings without overstating certainty.
Candidate Profile
- Proven experience delivering LLM agents for real-world users beyond prototypes.
- Hands-on expertise with agent skills, plugins, system prompts, or similar agent control frameworks.
- Strong evaluation methodology demonstrated by building evaluation suites, ground-truth data, and identifying regressions.
- Excellent written English communication skills as the role is heavily writing-focused.
- Proficiency in Python or TypeScript and ability to comprehend relevant codebases.
- Understanding of tool-/function-calling mechanics and agent tool selection processes.
- Knowledge of prompt injection risks, personally identifiable information handling, and failure scenarios in AI systems facing customers.
- Availability to overlap partially with US time zones for team collaboration.
- Preferred experience in ad-tech, digital advertising, or fraud detection domains (e.g., programmatic advertising, DSPs, SSPs, CTV, IVT concepts) or readiness to deeply learn within the first 90 days.
- Bonus points for experience with MCP servers or similar tool integrations, observability and tracing for LLM systems, retrieval systems including their failure modes, and data analysis skills involving SQL and large datasets.
Culture at Pixalate
We operate with small, high-output teams valuing concise communication and bold, fearless ideas. Titles carry less weight than results and collaboration is essential. Analytical mindset and data-driven decision-making are core to our environment. Chess enthusiasts and fearless innovators thrive here.
Benefits and Perks
- Competitive salary package
- Monthly internet reimbursement
- Remote and casual working conditions
- Flexible working hours
- Opportunities for career growth and skill development
- Engaging annual team events
- Work with a driven global team focused on winning while having fun