E2E project - Weather impacts on expressway traffic

Project information

The project use traffic data from automatic measurement and corresponding weather data in order to support analyses aimed at answering the question: Do weather conditions impact traffic?

The aim of the project is to design and implement entire data data flow using ETL/ELT tools and methods. The steps include: csv data extract and initial processing (Python), load to AWS S3 Data Lake (Python boto3, AWS CLI), staging (Snowflake) and transformation (dbt core), data warehousing (Snowflake), data prep and EDA (Python, pandas) and visualisation (Streamlit).

Python dbt snowflake Amazon Web S... MySQL dataset CSV AWS S3 aws-iam s3

82 Commits
1 Branch
0 Tags

README

Created on

March 19, 2025

Loading