A live transit-data lakehouse that ingests MBTA real-time feeds, computes on-time performance, and runs, heals, and improves itself — with an agentic layer that writes its own insights and opens pull requests.
A live transit-data lakehouse that ingests MBTA real-time feeds, computes on-time performance, and runs, heals, and improves itself — with an agentic layer that writes its own insights and opens pull requests.
A practical guide to building and orchestrating robust data pipelines using Apache Airflow, covering local, cloud (GCP), and Kubernetes deployments.
A step by step guide of a simple data pipeline