C-Tran Breadcrumbs Pipeline

Kafka data pipeline handling realtime C-Tran bus data.

For the course: Data Engineering. I won first prizes for best presentation, and for best extended features (I added logging, data backups and multiple modes of ingestion, as well as a guarantee to insert only once to protect from collisions)

Check out my presentation video on YouTube

Check out the code on github

Return Home