Automation Specialist, AI Data Service Operations

Job Overview

The primary goal of this role is to optimize the response efficiency and speed of AI agent prompts. You will oversee a fast-paced, multi-project workflow, utilizing sophisticated AI-powered diagnostic tools to iteratively refine complex prompt frameworks. This position focuses on creating resilient, scalable logical structures that reliably evoke the desired behavior from AI models, beyond just basic AI interaction.

Key Responsibilities

• Develop and implement advanced prompt engineering strategies such as Chain-of-Thought, Meta-Prompting, and Least-to-Most Prompting to precisely direct AI model responses.
• Utilize and maintain automated tools for root cause analysis and prompt agents to rapidly diagnose model failures and propose solutions within minutes.
• Perform detailed analyses of model hallucinations and classification mistakes to determine if issues arise from tokenization, logical errors, or settings like temperature variance.
• Execute frequent A/B testing on different prompt versions, swiftly adapting strategies based on results to favor robust, efficient designs while discarding complex or ineffective ones.
• Provide continuous feedback and updates for internal AI diagnostic tools, ensuring the technology remains cutting-edge.

Qualifications

• Bachelor's degree or higher, preferably in STEM, Linguistics, Philosophy, or related fields.
• Experience, including internships, in Large Language Models, prompt engineering, AI data or product operations, or similar areas.
• Strong analytical and logical reasoning capabilities with a keen eye for pattern recognition and problem definition, alongside adherence to standardized workflows.
• Ability to efficiently switch between multiple projects within a dynamic, high-attention workflow environment.

Preferred Experience

• Background in trust and safety, content moderation, review, classification, or annotation.
• Familiarity with NLP and LLM fundamentals, such as attention mechanisms, context windows, tokenization, and a solid grasp of model behavior and limitations.
• Basic programming skills in Python or SQL for scripting tasks supporting prompt testing and data analysis.

About the Company

TikTok, headquartered in Los Angeles and Singapore with offices worldwide, is the leading platform for short-form mobile videos, dedicated to inspiring creativity and spreading joy.

Why Join Us

At TikTok, innovation and creativity are at the heart of everything we do. We foster curiosity, humility, teamwork, and resilience in an environment geared for learning and impact. We embrace challenges with an "Always Day 1" mindset, enabling growth, innovation, and meaningful achievements for our users and ourselves.

Diversity & Inclusion

TikTok is dedicated to creating an inclusive workplace where diverse skills, experiences, and perspectives are celebrated, reflecting the global community we serve. We are passionate about fostering an environment that respects and values diversity.