Senior Data Engineer

About the Role

We are looking for a Senior Data Engineer to join a prominent financial services company located in Galway. This position suits professionals skilled in enterprise application development, with strong expertise in technology, coding, and data, eager to advance in a dynamic and fast-moving team environment. While the role favors full-stack capabilities, its primary focus lies in processing and producing analytics from both structured and unstructured data, with potential use of parallel processing, particularly within cloud platforms.

The role offers a unique chance to engage with prompt engineering involving Large Language Models (LLMs) like OpenAI's GPT-4, Google Gemini, and Anthropic Claude. Candidates will work on the design, optimization, and deployment of AI/ML pipelines in live production settings to generate business benefits and foster innovation.

Responsibilities

• Lead and execute the design and development of technical solutions within an accelerated enterprise environment.
• Collaborate effectively within teams, demonstrating strong leadership and influencing capabilities.
• Manage concurrency in multiple tasks, supporting a demanding workload with problem-solving and troubleshooting in an on-call rotation basis.
• Develop and maintain scalable applications and data pipelines that process large volumes of data efficiently.
• Prototype rapidly and bring projects from conceptual phases to deployment within short timelines.

Requirements

• Possess a Bachelor's or Master's degree in a technology-related discipline such as Engineering or Computer Science.
• At least six years of experience in enterprise software development, preferably in a fast adaptive environment.
• Demonstrated expertise in Python, with openness to candidates experienced in Java or C# who are willing to learn Python.
• Proficient in relational database management systems and AWS cloud services.
• Solid understanding of object-oriented programming concepts and data structures.
• Experience in designing and building custom data pipelines for data extraction, transformation, and loading across platforms such as Oracle, Snowflake, Amazon S3, and PL/SQL.
• Familiarity with APIs particularly RESTful services, and scripting on both Linux and Windows operating systems.
• Knowledge of cloud migration strategies to AWS is considered advantageous.

Additional Information

This role will involve participation in an on-call schedule to address production issues as they arise.