Welcome to the SQL Data Warehouse & Analytics Project! 🚀
This repository showcases an end-to-end data warehousing and analytics solution, covering everything from data ingestion to delivering actionable insights.
This project follows the Medallion Architecture framework with Bronze, Silver, and Gold layers:
- Bronze Layer: Contains raw ingested data as-is from source system.
- Silver Layer: Handles data cleaning, standardization, and transformation for consistency.
- Gold Layer: Stores curated, business-ready data modeled in a star schema for analytics and reporting.
The project includes the following key components:
- Data Architecture - Designing a modern data warehouse using Medallion layers.
- ETL Pipelines - Extracting, transforming, and loading data into the warehouses.
- Data Modelling - Building fact and dimension tables optimized for analytical queries.
- Analytics & Reporting - Delivering insights through SQL queries and dashboards.
- Datasets: Raw CSV datasets used in the project.
- SQL Server Express: Lightweight database server for hosting the warehouse.
- SQL Server Management Studio: GUI for database management and interaction.
- Github: Version control and collaboration platform.
- DrawIO: Tool for designing diagrams, models, and flows.
- Notion Project Steps: Access detailed project steps and tasks.
Made with ☕ for data engineering.