About
Data Engineer with hands-on experience building Medallion-architecture and lakehouse pipelines using Python, SQL, PySpark, Delta Lake, and AWS S3. Strong project focus on data quality, incremental ingestion, MERGE upserts, orchestration, and dimensional modeling.
Education
-
2027
Bachelor of Computer Applications (BCA)Maharaja Suhel Dev State University (MSDU)Computer Applications · Jul 2024 – Jun 2027
Skills
Tools / apps / platforms
Projects
-
Pizza Sales SQL AnalysisSQL, MySQL, Relational Modeling, Analytical SQL
Modeled 21,350 orders in MySQL and used analytical SQL to calculate revenue, category contributions, top-selling pizzas, and hourly order distributions.
-
FMCG Databricks Lakehouse PipelineDatabricks, PySpark, AWS S3, Delta Lake, SQL
Built full-load and incremental notebooks to consolidate subsidiary customer, product, pricing, and order data into a parent-company dimensional model through Bronze, Silver, and Gold layers. Used Delta Lake MERGE, Change Data Feed, and parameterized notebooks to align daily subsidiary orders with monthly parent-company facts.
-
Chicago Crimes Data PipelinePython, SQL, MotherDuck, GitHub Actions
Built a Bronze-Silver-Gold pipeline for 1.57M+ unique crime records, using paginated Socrata API extraction, a 24-hour watermark overlap, exponential-backoff retries, staging deduplication, and ID-based MERGE operations. Rebuilt Silver and Gold layers inside a transaction with rollback on failure, and scheduled daily execution with GitHub Actions.
Courses & certifications
- SQL for Data Science · Simplilearn
- SQL (Advanced) · HackerRank