Tagged “terraform” 2

Building a Self-Managing MBTA On-Time-Performance Lakehouse (Databricks + GCP)

A live transit-data lakehouse that ingests MBTA real-time feeds, computes on-time performance, and runs, heals, and improves itself — with an agentic layer that writes its own insights and opens pull requests.

data engineeringdatabricksgcplakehousesparkstructured streamingterraformci-cdagentic
Simple Data Pipeline

A step by step guide of a simple data pipeline

data engineeringbeginnerstutorialdockerterraformgcppythonpostgresql