AI Test Engineer (f/md)

Job description

Verwaltungssprung is a Berlin-based GovTech company developing AI-powered software solutions to simplify and digitize administrative processes. Our platform enables citizens and public institutions to access secure, user-friendly, and fully digital public services.
To support the growth of our organization, we are looking for an AI Test Engineer (f/md) who is passionate about ensuring the reliability, security, and quality of AI-driven applications in the public sector. In this role, you will help validate and optimize AI systems that directly impact digital government services and citizen experiences.
In this role, you will design, develop, and optimize AI-powered solutions that help modernize public administration and create seamless digital experiences for citizens and institutions.
Tasks

Design, implement, and maintain testing strategies for AI-powered applications and machine learning systems
Evaluate AI model performance, accuracy, robustness, and reliability across different use cases
Identify system weaknesses, edge cases, biases, hallucinations, and security vulnerabilities
Develop automated test frameworks and quality assurance processes for AI solutions
Collaborate closely with AI Engineers, Product Managers, and Software Developers throughout the development lifecycle
Analyze datasets and outputs to ensure compliance with quality and ethical standards
Support continuous improvement of AI systems through structured feedback and testing insights
Document testing methodologies, findings, and recommendations for internal and external stakeholders
Contribute to establishing best practices for responsible and trustworthy AI within public administration environments

Requirements

Degree in Computer Science, Software Engineering, AI, Data Science, or a related field
Experience in software testing, quality assurance, or AI/ML system evaluation
Strong understanding of machine learning concepts, AI system behavior, and testing methodologies
Familiarity with automated testing tools, scripting languages, and test frameworks
Experience analyzing model outputs, performance metrics, and potential biases
Understanding of security, privacy, and compliance considerations in AI applications
Strong analytical thinking and problem-solving skills
Excellent communication skills and the ability to work in interdisciplinary teams
Fluent in English; German is a plus

Benefits

Attractive above-average compensation package
State-of-the-art IT equipment enabling flexible hybrid working worldwide - from home, our Berlin office, or on-site with partners
Centrally located offices with access to the unique ThinkTank Campus in Berlin-Wannsee
Comfortable travel policy as well as free snacks and beverages in our offices
Flat hierarchies, fast decision-making, and room for your own ideas
International team spirit with recognition of both collective and individual successes
Early responsibility and creative freedom from day one
Structured onboarding with a buddy and experienced mentor
Continuous training programs and regular development discussions

Join Verwaltungssprung and become part of a mission-driven team building the future of digital public services. If you are passionate about analyzing complex administrative systems and transforming them into meaningful digital solutions with real societal impact, we would love to hear from you.
Find Jobs in Germany on Arbeitnow