Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

SWAPNIL NAGPURE

Hyderabad

Summary

A highly adaptable, results-oriented, and resourceful professional with over 8+ years of experience in leading analytical projects across various industries. Proven success in analysis, design, development, implementation, and troubleshooting of ETL processes using Azure Data Factory, Azure Databricks,Azure Synapse Analytics, and other Azure services. Strong domain knowledge in Banking, Insurance, Retail, and Mining, with a focus on delivering impactful data-driven solutions.

Overview

9
9
years of professional experience
1
1
Certification

Work History

Data & AI Consultant

Microsoft
03.2022 - Current

HDFC | Credit Analytics | EDW Data Migration Team

  • Cloud Migration & Data Strategy: Led migration of 9 source systems to Azure Cloud, enhancing data access and decision-making. Contributed to the shared data services foundation and cloud migration strategy for data lake development.
  • Process Optimization & Automation: Implemented PyLint-based automated code quality checks in Python and PySpark, enhancing maintainability. Developed frameworks for data validation and encryption, leading to a 20% decrease in debugging time and increased code quality.
  • System Integration & Performance Optimization: Migrated critical systems from UNIX to Python and integrated Vertical Pipeline Orchestration and Schema Evolution frameworks across 46 production pipelines, resulting in a 70% improvement in processing speed and 50% reduction in system downtime.
  • Leadership & Cross-Functional Collaboration: Led sprint planning and product backlog grooming, driving improved reporting accuracy, compliance, and operational efficiency through key project developments.

Project: CCWIS – Data Migration

  • Data Migration & Cloud Integration: Migrated data from On-Prem Oracle to Azure SQL, modernizing architecture, reducing costs, and improving data accessibility. Integrated cloud platforms to drive scalability and data-driven decision-making.

Project: UBS – Data Analytics

  • Stakeholder Collaboration & Data Analysis: Defined business requirements and use cases, improving data quality and project outcomes. Developed Power BI reports to enhance efficiency, user experience, and decision-making.

Project: Evonik Industries

  • Data Transformation & Knowledge Transfer: Led ML model migration to Azure, facilitating the customer’s cloud journey. Delivered knowledge transfer sessions, resulting in a 4/5 customer satisfaction score.

Sr. Azure Data Engineer

YASH Technologies
12.2020 - 03.2022

Project : Anglo American

  • Spearheaded data integration across diverse sources like OData Feed, REST API, Event Hub, Azure SQL, Synapse Server, On-premise SQL Server, and SharePoint, creating a unified and reliable data ecosystem.
  • Designed and implemented ETL pipelines in Azure Data Factory and Azure Databricks, optimizing data transformation processes and enabling seamless EDM and DIM table loads using SQL stored procedures.
  • Automated critical workflows with Azure Logic Apps and Azure Key Vault, reducing manual effort and improving process efficiency and accuracy.
  • Provided technical expertise through issue resolution, stakeholder collaboration, and team training, enhancing data quality, operational excellence, and team productivity.

Azure Data Engineer

New Balance
07.2019 - 12.2020
  • Developed Azure Data Factory (ADF) pipelines to integrate data from diverse sources, applying complex transformations and business logic to meet BI solution requirements, ensuring high-quality data outputs.
  • Designed and implemented Azure SQL Server and Azure Data Warehouse solutions, enhancing data storage efficiency and enabling seamless reporting and analytics.
  • Performed data modeling for critical modules, improving data structure and enabling better insight generation for decision-making.
  • Collaborated directly with users and external teams to gather requirements, analyze data, and retrieve information from source systems, ensuring alignment with business needs and timely delivery.

Azure Data Engineer

Tata Consultancy Services (TCS)
12.2017 - 06.2019
  • Developed robust Azure Data Factory (ADF) pipelines to integrate and transform data from multiple sources, ensuring accurate and efficient data workflows.
  • Optimized data storage and retrieval by leveraging Azure Data Lake for structured and unstructured data streams and integrating Azure SQL Data Warehouse with external tables on Azure Blob Storage.
  • Enhanced data processing capabilities by creating efficient SQL server objects, including stored procedures, views, and functions, to support complex business requirements.
  • Improved decision-making through Power BI visualizations, building interactive dashboards, data models, and relationships, and ensuring data is well-structured and actionable.

PLSQL Developer

Tata Consultancy Services (TCS)
01.2016 - 11.2017

Project : AXA Insurance

  • Developed and optimized PL/SQL procedures, functions, and objects (triggers, records, packages) to streamline backend operations, enhance API integration, and improve data flow efficiency.
  • Created and maintained the Methods Traceability Matrix, ensuring traceability across components and improving application understanding.
  • Delivered stored procedures, packages, and data insights to the front-end team, driving smoother development processes and enhancing collaboration.
  • Tuned database performance by optimizing SQL scripts, analyzing tables and indexes, and conducting unit testing, resulting in faster data retrieval and high-quality deliverables.

Education

M.Tech. - Data Science And Engineering

BITS Pilani
Hyderabad
11-2024

Bachelor of Engineering - Electronics and Communication

University of Nagpur

H.S.C -

Maharashtra State Board

S.S.C -

Maharashtra State Board

Skills

  • Azure Data Factory
  • Azure Databricks
  • Python,Pyspark , TSQL/PLSQL, Kusto
  • Azure SQL Database
  • Azure Synapse Analytics
  • Azure Data Explorer
  • Azure Data Lake Storage Gen 1 & Gen2
  • Azure Logic Apps
  • Azure AI services
  • Azure Key Vault , Azure Devops
  • Microsoft Power BI

Certification

  • Microsoft Certified: Azure Data Engineer Associate (DP-203)
  • Microsoft Certified: Azure AI Engineer Associate (AI-102)
  • Microsoft Certified : Data Analyst Associate(DA-100)
  • Microsoft Certified: Azure Fundamentals (AZ-900)
  • Microsoft Certified: Azure Data Fundamentals (DP-900)
  • Microsoft Certified: Azure AI Fundamentals(AI-900)

Timeline

Data & AI Consultant

Microsoft
03.2022 - Current

Sr. Azure Data Engineer

YASH Technologies
12.2020 - 03.2022

Azure Data Engineer

New Balance
07.2019 - 12.2020

Azure Data Engineer

Tata Consultancy Services (TCS)
12.2017 - 06.2019

PLSQL Developer

Tata Consultancy Services (TCS)
01.2016 - 11.2017

S.S.C -

Maharashtra State Board

M.Tech. - Data Science And Engineering

BITS Pilani

Bachelor of Engineering - Electronics and Communication

University of Nagpur

H.S.C -

Maharashtra State Board
SWAPNIL NAGPURE