Senior Data Engineer

Job Overview

We are seeking a Senior Data Engineer to lead the design, development, and enhancement of our overseas data warehouse and platform. This role covers extensive domains including mobile device data, IoT, and application data.

Key Responsibilities

• Architect and implement scalable data processing systems and analytic applications that convert raw data into actionable insights.
• Utilize advanced techniques such as data mining, data modeling, natural language processing (NLP), and machine learning to derive value from large-scale structured and unstructured datasets.
• Design and optimize both batch and real-time data pipelines using tools like Spark and Flink, ensuring they are performant, scalable, and reliable.
• Define data warehouse architecture including ODS, DWD, DWS, and ADS layers, and establish data governance practices focusing on data quality, lineage, and metadata management.
• Lead the development of data products including dashboards, visualization frameworks, and dynamic reporting systems.
• Collaborate closely with business, product, and analytics teams to translate complex requirements into scalable data solutions.
• Provide mentorship to junior engineers and advocate for best practices in data engineering and analytics.

Required Qualifications

• Bachelor’s degree or higher in Computer Science, Data Engineering, or a relevant field.
• Minimum of 5 years' experience in data engineering or developing data platform solutions.
• Comprehensive expertise with big data technologies like Spark, Flink, and the Hadoop ecosystem.
• Strong background in data modeling and designing large-scale data warehouses.
• Proficiency in programming languages including Python, Java, or Scala.
• Practical experience with machine learning, NLP, or sophisticated analytics workflows is highly desirable.
• Familiarity with data visualization tools and the construction of data products such as dashboards and reporting systems.
• Strong grasp of processing structured and unstructured data.
• Demonstrated ability to optimize large data systems and pipelines.
• Excellent communication skills combined with the ability to manage stakeholder relationships effectively.
• Experience working with international or overseas data environments is beneficial.
• Languages: Fluency in Mandarin and English to enable coordination and collaboration with Mandarin-speaking teams and partners across different regional markets.