B

Data Platform Engineer

Block Labs

Remote · Full Time

Be the first to apply

Experience
3+ yrs
Salary
—
Openings
1
Posted
4 days ago
Work mode
Work from home
Resume
Required to apply

Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.

Job description

About Block Labs

Block Labs is a leading technology studio advancing the frontiers of Web3, Artificial Intelligence, and iGaming by building robust, production-grade platforms. Our team consists of senior engineers and strategists committed to superior architecture and long-term product ownership. We focus on creating autonomous AI systems, decentralized financial infrastructures, and scalable iGaming solutions with a dedication to excellence.

Role Overview

The Data Platform Engineer will drive the development of a critical data platform powering real-time decision-making and predictive analytics across multiple products. This position entails building and maintaining scalable data pipelines and a performant analytical warehouse, serving as the backbone for multi-tenant systems aimed to grow from single to multiple operators efficiently.

Key Responsibilities

  • Design and sustain scalable data pipelines using AWS Glue (PySpark) or similar orchestration tools.
  • Optimize ClickHouse data warehouse for rapid, sub-second query responses supporting back-office operations.
  • Implement data contracts to standardize integrations allowing operator onboarding through configuration changes without new schema creation.
  • Develop a feature-serving layer delivering millisecond-latency features to AI agents.
  • Integrate various external databases, back-office APIs, and third-party systems such as CRM and affiliate platforms.
  • Establish robust monitoring, alerting, and maintenance protocols including pipeline health and anomaly detection.
  • Manage CI/CD workflows and infrastructure-as-code for data workloads.
  • Collaborate cross-functionally with data scientists, engineers, BI teams, and infrastructure groups to translate requirements into reliable pipelines.

Candidate Profile

  • Minimum 3 years of experience developing and maintaining production-grade data pipelines supporting streaming and batch processes.
  • Advanced knowledge of Apache Kafka or Amazon MSK involving topic design, consumer group management, and performance troubleshooting.
  • Proficient in SQL and analytical database engineering with strong experience on columnar databases like ClickHouse, Druid, BigQuery, or Redshift.
  • Expertise in PySpark/Spark Streaming including crafting transformation workflows for normalization and business rule enforcement. Familiarity with AWS Glue, Apache Airflow, or Apache NiFi is advantageous.
  • Skilled in multi-tenant data modeling, schema governance, and enforcing data contract standards.
  • Experience with CI/CD automation, infrastructure-as-code tools such as CloudFormation, Terraform, or CDK, and container-based deployment platforms like ECS Fargate or Kubernetes.
  • Strong data observability background encompassing pipeline monitoring, automated validation, freshness metrics, and anomaly detection.

Desirable Skills

  • Exposure to iGaming, online casino, poker, or sportsbook environments.
  • Knowledge of blockchain or crypto transaction processing including on-chain event ingestion and tokenized accounting.
  • Experience within AWS-native stacks (MSK, Glue, S3, DynamoDB, ECS, IAM) with a grasp on serverless cost optimization.
  • Familiarity with feature store technologies (SageMaker, Feast, Tecton) for ML inference pipelines.
  • Background in regulated sectors (financial services, gambling, fintech) with an emphasis on data lineage and compliance requirements.
  • Experience migrating legacy query engines to modern analytical warehouses and validating data integrity.

Work Environment

  • Fully remote working with a preference for Europe time zone overlap.
  • Part of a small, autonomous Data team reporting to Head of Data and coordinating widely across AI, BI, and Infrastructure.
  • Participation in architectural design discussions and ownership of domain-specific system decisions.
  • Focus on scalable, multi-tenant designs from inception to avoid engineering rework.
  • Initial focus on build velocity and quality; on-call duties to commence post-launch without legacy system firefighting.

Culture

Block Labs fosters a mature, mission-driven, and modest culture prioritizing clarity, measurable outcomes, and disciplined pace. The environment suits highly skilled professionals seeking to collaborate with peers of equally high caliber.

Tools & software

Apache Kafka · 2 to 5 years required Apache Airflow required

How they work

Teamwork & Collaboration Attention to Detail Accountability
🤖
Online · instant AI help
Broxer