Skip to content
View hari-shadow's full-sized avatar
2 followers · 3 following

Achievements

Achievement: Pull Sharkx2

Achievements

Achievement: Pull Sharkx2

Block or report hari-shadow

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
hari-shadow/README.md

Hariharan Sridhar

Data Engineer  ·  Self-Taught  ·  Problem-Driven  ·  Tamil Nadu, India

LinkedIn   Email   Open to Work

What I Build

I design and operate data pipelines, lakehouses, and cloud data platforms — built from real business problems, not coursework.

At Torque Lithium Energy, I built the company's entire data infrastructure from scratch: designed the CRM PostgreSQL schema, built an Airbyte CDC pipeline into AWS S3, and architected a Bronze → Silver → Gold medallion lakehouse on Databricks + dbt. Everything I know came from seeing a problem, researching a solution, and implementing it.

Tech Stack

Ingestion & Orchestration

Airbyte Apache Airflow Prefect Snowpipe

Transformation & Warehousing

dbt Snowflake Databricks PostgreSQL AWS S3

Languages

Python SQL

BI & DevOps

Power BI GitHub Actions Linux Git

Projects

Project What it does Stack
Enterprise Lakehouse Pipeline CDC pipeline — Postgres → Airbyte → S3 → Databricks → dbt → Prefect. Medallion architecture with SCD Type 2 and CI/CD data quality gates. Airbyte · Databricks · dbt · Prefect · AWS S3
E-Commerce Data Platform Streaming platform ingesting 100K+ orders via Snowpipe with BRL→USD currency conversion using Snowflake ASOF JOIN. Snowflake · Snowpipe · dbt · Airflow · AWS S3
SQL Data Warehouse Bronze→Silver→Gold warehouse in PostgreSQL. Resolves 6 categories of data quality issues across CRM + ERP sources via stored procedures. PostgreSQL · PLpgSQL
SQL Customer Analytics LTV segmentation, cohort analysis, and churn detection. Top 25% of customers drive 66% of revenue ($135.4M). SQL · PostgreSQL
All projects are self-built — no templates, no guided tutorials. Each one started with a problem.

Pinned Loading

  1. ecommerce_data_platform ecommerce_data_platform Public

    An end-to-end data engineering project built on the Olist Brazilian E-Commerce dataset and the Frankfurter currency API. The platform ingests, transforms, and serves data through a medallion archit…

    Python

  2. enterprise-lakehouse enterprise-lakehouse Public

    Enterprise lakehouse pipeline — Neon Postgres → Airbyte CDC → S3 → Databricks + dbt (medallion) → Prefect orchestration

    Python

  3. sql-data-warehouse sql-data-warehouse Public

    PLpgSQL

  4. sql-data-analysis-depth sql-data-analysis-depth Public

    Analysis of customer behavior, retention, and lifetime value for an e-commerce company to improve customer retention and maximize revenue.