AI Application Engineer – AI Products (LLM & RAG)

About Machine Learning Reply GmbH

At Machine Learning Reply, our mission is to transform cutting-edge artificial intelligence technologies into practical applications and scalable digital products that deliver tangible business benefits.

Role overview

We are searching for an AI Application Engineer passionate about creating AI-driven solutions and smart product functionalities utilizing modern machine learning and generative AI methods. Unlike our GenAI Engineers, who specialize in model creation and AI infrastructure, this role centers on building AI applications that directly interact with users and converting AI capabilities into scalable products.

Responsibilities

• Design and develop AI-enabled applications and advanced product features targeted at enterprise clientele, including enterprise assistants, AI copilots, semantic search platforms, and intelligent automation systems.
• Develop applications powered by large language models (LLMs) through Retrieval-Augmented Generation (RAG) frameworks and up-to-date AI toolkits.
• Create end-to-end AI products that combine LLM APIs, corporate data sources, and backend services seamlessly.
• Architect scalable AI microservices and APIs for embedding AI capabilities within enterprise platforms.
• Implement vector search algorithms, embedding workflows, and knowledge retrieval mechanisms.
• Quickly prototype AI features and proof-of-concept models and evolve these into robust production systems.
• Partner closely with product managers, UI/UX designers, AI engineers, and enterprise customers to develop impactful AI-powered applications.
• Deploy AI solutions on cloud infrastructure applying modern DevOps methodologies for production readiness.
• Ensure AI services are reliable, scalable, and observable by leveraging CI/CD pipelines, monitoring tools, and containerization.

Requirements

• A degree in Computer Science, Software Engineering, Data Science, or an equivalent technical discipline.
• Strong communication and presentation capabilities in both German and English to effectively contribute to bilingual workshops.
• Proficient programming skills in Python and familiarity with contemporary backend frameworks.
• Experience developing software utilizing AI, machine learning, or generative AI approaches.
• Knowledge of Retrieval-Augmented Generation (RAG) methods and vector database technologies.
• Familiarity with cloud computing platforms such as AWS, Azure, or Google Cloud Platform.
• Ability to engage directly with enterprise clients to grasp their business needs and identify opportunities for impactful AI solutions.

Preferred qualifications

• Experience facilitating technical workshops and guiding solution design discussions.
• Background in developing APIs, microservices, and scalable backend infrastructure including vector database management.
• Hands-on experience with containerization and DevOps workflows (e.g., Docker, CI/CD pipelines, Kubernetes or equivalents).
• Familiarity with modern AI frameworks such as LangChain, LlamaIndex, or HuggingFace.
• Practical experience deploying AI services in cloud environments.
• Understanding of AI system observability, monitoring, and evaluation, especially regarding LLMs.

Potential projects

• Building enterprise AI knowledge assistant tools.
• Developing AI copilots to support internal business applications.
• Creating semantic search platforms tailored for corporate data access.
• Implementing document intelligence systems powered by large language models.
• Designing AI agents and automation workflows for enterprise operations.

Benefits and work environment

• Collaborate in a transparent and cooperative setting within the international Reply network, developing next-generation AI applications and intelligent digital products.
• Work alongside interdisciplinary teams of AI engineers, software developers, and data scientists across various sectors including Banking, Insurance, Automotive, and Retail.
• Participate in an active social program that offers paid training, conferences, communities of practice, hackathons, and networking events within Reply.
• Enjoy monetary benefits such as mobility packages, gym subsidies with WellPass, insurance and pension schemes, corporate savings plans, as well as childcare allowances.
• Benefit from flexible working arrangements including options for home office, EU-wide remote workations, office access in downtown Munich near Stammstrecke, and onsite client visits.