Tagged “airflow” 3

Vitals: A Governed Medallion Lakehouse for Healthcare Data

A health-data lakehouse that turns messy FHIR, claims, wearable, and notes data into three trusted outputs — analytics marts, an ML feature store, and a vector index — with de-identification, OMOP standardization, and cross-engine parity testing that caught a real de-id gap.

data engineeringdatabrickslakehousedbtairflowsparkdata qualityhealthcaremlops
Building a Customer Analytics Pipeline with Airflow, dbt and Spark

A production-grade ELT pipeline that automates daily identification of high-value customers using Apache Airflow, dbt-spark, and Apache Iceberg.

data engineeringairflowdbtsparkdockericeberganalyticspipeline
Orchestrating Data Pipelines with Apache Airflow: A Comprehensive Guide

A practical guide to building and orchestrating robust data pipelines using Apache Airflow, covering local, cloud (GCP), and Kubernetes deployments.

data engineeringairfloworchestrationtutorialdockergcpkubernetesbigquerydata warehouse