Lead Data Engineer
Lead Data Engineer with 20+ years experience building scalable data infrastructure on AWS. Expert in Python, Terraform, and serverless architectures. Specialized in designing end-to-end data platforms, automating ETL workflows, and optimizing pipelines for performance and cost-efficiency. Skilled at translating business requirements into practical solutions while leading agile teams and mentoring engineers.
AWS Certified AI Practitioner
SnowPro Core
AWS Certified Developer
Certified ScrumMaster
Oracle 9i Certified Associate
Hunter Labs AWS Serverless Data Lakehouse is the platform behind my data products, designed to stay event-driven and serverless so it costs almost nothing when idle. Terraform provisions the AWS foundation, Python Lambdas and Step Functions move new files through ingestion and sanitisation, and S3 Tables with Apache Iceberg provide the lakehouse layer for Athena, DuckDB, Streamlit apps, and Prefect.io curation flows.
Hidden Gems is a small movie discovery site that surfaces one curated film each day from Netflix and Prime Video. It combines AWS-hosted data pipelines, Prefect orchestration, Terraform-managed infrastructure, and a lightweight static front end to publish daily picks, refresh JSON content, invalidate CloudFront, and push matching posts to X, with a clean landing page, direct watch links, and a fully automated publishing flow behind the scenes.
View Hidden GemsReady to discuss your next data engineering project?
Let's Connect