Applied AI Scientist

About NET CHECK GmbH

Established in 1999, NET CHECK GmbH specializes in enhancing communication network quality. It serves as a top partner for mobile and fixed network operators and infrastructure providers by offering international network benchmarking, network planning, and fault analysis. With one of Germany's largest crowdsourcing platforms, it produces over 144 million data points daily and maintains strong ties to scientific and governmental institutions. The company is headquartered in Berlin and belongs to the owner-managed NC GROUP, comprising over 180 employees across six locations.

Job Summary

The role involves developing AI platforms that convert complex telecom data—such as drive tests, voice quality metrics, broadband diagnostics, and signaling analyses—into straightforward, actionable insights. The position requires blending analytical prowess with engineering capabilities to design machine learning and agentic AI solutions from prototyping through deployment.

Key Responsibilities

• Design and implement agentic AI systems and Retrieval-Augmented Generation (RAG) pipelines capable of reasoning over technical documents and real-time network data.
• Own the testing and evaluation processes by creating datasets, metrics, and benchmarks to monitor accuracy, retrieval quality, latency, and operational cost, ensuring system robustness before user release.
• Enhance evaluation and observability workflows, including both offline and online testing, applying large language model (LLM) adjudication, regression testing, and quality dashboards specifically for agentic AI and RAG frameworks.
• Translate data science findings into production-grade AI tools, handling the full development life cycle from analysis to MLOps and operationalization.
• Develop and refine machine learning models addressing classification, anomaly detection, root-cause investigation, and similar challenges, integrating them within the platform.
• Produce clean, maintainable, and rigorously tested code, advocating high engineering standards among the team.
• Investigate and experiment with novel AI models and techniques, converting promising research into practical production features.
• Collaborate closely with engineers, data scientists, and domain specialists to deliver effective solutions tailored to telecom industry problems.

Required Qualifications and Experience

• Doctorate (PhD) in a quantitative field such as Physics, Mathematics, Computer Science, Engineering, or related natural sciences, accompanied by strong practical skills in mathematical and computational modeling.
• At least 3 years of experience developing software or machine learning systems in industry or research contexts after or alongside academic studies.
• Hands-on practice with AI agents and Retrieval-Augmented Generation systems, specifically in implementing large language model-based solutions.
• Proficiency in data science and machine learning techniques, familiar with frameworks like scikit-learn, XGBoost or LightGBM, and deep learning libraries.
• Robust software engineering skills, especially using Python, with an emphasis on writing clean, organized, tested, and maintainable code.
• Understanding of agentic AI architecture, including orchestration, tool integration, memory management, evaluation frameworks, and safety mechanisms.
• A research-driven mindset with eagerness to stay current on AI advancements and incorporate them into practical tools.
• Fluency in English and strong interpersonal, communication, and teamwork abilities.
• Experience deploying ML models in the cloud, preferably AWS services such as Bedrock, ECS, and S3, and familiarity with AI/LLM utilities like LangGraph, Chroma, FAISS, LangSmith, or Langfuse, including aspects like evaluation, monitoring, prompt engineering, and cost optimization is advantageous.
• Background or familiarity with telecommunications, networking, signal processing, or other heavily data-dependent technical fields is a plus.

Benefits and Employment Details

• This is a full-time, indefinite-term position.
• Opportunity to influence AI strategy within a dynamic company equipped with cutting-edge AI tools and research prospects.
• Flexible working hours to accommodate individual circumstances.
• 28 days of vacation annually.
• Subsidies provided for sports memberships and public transportation throughout Germany.
• Bicycle leasing available through JobRad.
• Regularly organized team-building events.