Data Engineer

About Kogan.com

Kogan.com is a trailblazer in the Australian eCommerce sector, delivering software solutions utilized daily by millions of customers. Join a dynamic and fast-paced engineering environment where real ownership is given, production deployments happen every day, and AI technologies are integrated into the workflow.

Role Overview and Responsibilities

• Design and operate scalable ETL/ELT data pipelines managing over 10 million daily events and extensive data transfers across various platforms.
• Create and fine-tune data models in platforms like BigQuery or Snowflake to enhance performance for analytics and machine learning training datasets while maintaining cost efficiency.
• Provide support for machine learning processes by constructing foundational features and input data needed for models.
• Develop and enhance machine learning models intended for practical business applications, such as analyzing customer sentiment, predicting churn, and forecasting demand.
• Implement MLOps pipelines to automate model deployment and continuous monitoring in live environments.
• Integrate internal APIs and third-party services to efficiently ingest data, ensuring strict adherence to data integrity standards.
• Establish and follow best practices for data governance, including quality assurance, security measures, and comprehensive documentation to maintain data as a reliable source of truth.
• Adhere to software engineering best practices encompassing version control (Git), continuous integration and deployment (CI/CD), trunk-based development, and automated testing.
• Engage in AI and large language model (LLM) experiments aimed at practical business problem-solving.

Required Skills and Qualifications

• Strong proficiency in SQL, capable of writing optimized queries that efficiently handle millions of rows and complex joins in commercial environments.
• Experience using pipeline orchestration technologies such as Apache Airflow, dbt, or AWS Glue to develop and maintain robust data workflows in production.
• Advanced Python programming skills for performing data transformations, scripting, and interacting with diverse data systems.
• Exposure to machine learning engineering, including building data infrastructure to support ML workflows, data preprocessing, and deployment of models, alongside hands-on model development.
• Practical experience in cloud data platforms, particularly Google Cloud Platform (GCP). Strong preference is given to candidates with this background.
• Knowledge of software engineering best practices, including using Git, continuous integration/deployment pipelines, and basic containerization tools like Docker to ensure high-quality and reliable code deployment.
• A pragmatic engineering approach focusing on rapid delivery balanced with maintaining system stability and scalability over time.

Why Join Kogan.com?

• Contribute directly to machine learning, data, and AI solutions impacting millions of users and influencing core business metrics.
• Take full ownership of projects, from initial trials and modeling through to deployment and ongoing system improvement.
• Work within an empowered engineering team that prioritizes autonomy, swift execution, and innovative yet practical solutions.
• Play a key role in advancing AI, machine learning, and eCommerce technologies at one of Australia's premier tech companies.
• Benefit from a $1,000 annual learning budget committed to your professional growth.
• Access a variety of perks such as complimentary Kogan First memberships, team product discounts, health and wellness programs, knowledge-sharing events like Lunch & Learns and hackathons, referral incentives, volunteer opportunities, and frequent team gatherings.