Iain Hunter BA (Hons)

Lead Data Engineer

Stirling, Scotland

About

Lead Data Engineer with 20+ years experience building scalable data infrastructure on AWS. Expert in Python, Terraform, and serverless architectures. Specialized in designing end-to-end data platforms, automating ETL workflows, and optimizing pipelines for performance and cost-efficiency. Skilled at translating business requirements into practical solutions while leading agile teams and mentoring engineers.

Tech Stack

Python AWS Terraform SQL Pandas Snowflake Apache Airflow AWS Lambda AWS Step Functions Amazon S3 AWS DMS Streamlit Data Engineering Data Architecture

Certifications

AWS Certified AI Practitioner

SnowPro Core

AWS Certified Developer

Certified ScrumMaster

Oracle 9i Certified Associate

Projects

Hidden Gems

Hidden Gems is a small movie discovery site that surfaces one curated film each day from Netflix and Prime Video. It combines AWS-hosted data pipelines, Prefect orchestration, Terraform-managed infrastructure, and a lightweight static front end to publish daily picks, refresh JSON content, invalidate CloudFront, and push matching posts to X, with a clean landing page, direct watch links, and a fully automated publishing flow behind the scenes.

View Hidden Gems

Let's Connect

Ready to discuss your next data engineering project?

Let's Connect