Mar 2023 to present · Remote
Joined as a Data Engineer in March 2023; promoted to Senior Data Engineer in April 2024.
Leading the data platform team: lakehouse architecture, streaming and the migrations that pay for themselves.
- Built and lead a team of six data engineers running enterprise ETL/ELT pipelines on Databricks across hybrid AWS and Azure.
- Architected a Medallion lakehouse (Bronze, Silver, Gold) that processes 7+ TB a day across Azure, AWS, GCP, Snowflake, Redshift and BigQuery.
- Re-platformed legacy ETL onto Azure Data Factory, Databricks, Snowflake and Delta Lake, cutting operational costs by 40%.
- Own high-throughput batch and CDC pipelines in Python and PySpark, orchestrated with Airflow and dbt, with NiFi and Informatica handling ingestion at source.
- Added a real-time streaming layer on Kafka, Spark Streaming and Azure Event Hub for sub-second data availability.
- Set the standards for data quality, governance, cataloguing and lineage with Unity Catalog and Schema Registry, and automated infrastructure with Terraform, Docker, Kubernetes and CI/CD.
- Mentor engineers across seniority levels on data modelling, query and pipeline performance, and cloud-native architecture.
DatabricksPySparkAzure Data FactorySnowflakeKafkaAirflowdbtNiFiTerraformKubernetes




