Summary
Overview
Work History
Education
Technical Skills
Timeline
Generic
Aniket Kulkarni

Aniket Kulkarni

Hyderabad

Summary

Detail-oriented and results-driven Data Engineer with 6+ years of total experience, including 3+ years in Data Engineering and 2.5+ years in Data Analytics and Reporting. Skilled in building scalable data pipelines, leading on-prem to Azure Cloud migrations, and optimizing performance using Azure Data Factory, Azure Databricks (PySpark), Synapse Analytics, and Delta Lake. Experienced in implementing Medallion Architecture (Bronze–Silver–Gold), transforming API data, automating ETL workflows, and improving pipeline runtimes by up to 40% through Spark optimizations. Proficient in developing secure, analytics-ready datasets with strong data governance and reporting via Tableau and Looker Studio.

Overview

6
6
years of professional experience

Work History

Senior Data Associate

Lloyds Technology Centre
01.2024 - Current
  • Led end-to-end data migration from on-premise SQL Server to Azure Cloud, leveraging Azure Data Factory (ADF) for orchestration and Azure Databricks (ADB) for transformation.
  • Designed scalable ETL pipelines in ADF, integrating with Azure Blob Storage, Data Lake, and Synapse Analytics to enable seamless data movement and monitoring.
  • Implemented Delta Lake architecture in Databricks, introducing Bronze–Silver–Gold data layers for better data governance, auditability, and modular transformations.
  • Applied Spark optimization techniques such as caching, predicate pushdown, broadcast joins, and partitioning, which led to 45% faster data processing and 30% lower resource consumption during nightly jobs.
  • Refactored legacy ETL logic into PySpark-based Databricks notebooks, reducing pipeline run times by 40% and improving overall data freshness.
  • Managed creation and optimization of Delta Tables with time travel and schema enforcement features, enabling robust change tracking and rollback capabilities.
  • Collaborated with Data Architects and Business Analysts to ensure alignment on data modeling in Synapse and optimized query performance for downstream analytics.
  • Developed monitoring and alerting frameworks using ADF's integration with Azure Monitor and Log Analytics, increasing pipeline reliability and issue response time by 50%.
  • Conducted code reviews, documented migration processes, and trained junior engineers on Spark and Delta best practices.

Data Analyst

Emeritus
01.2022 - 01.2024
  • Built and automated ETL pipelines using Azure Data Factory and Azure Databricks (PySpark) for course and certification reporting.
  • Migrated Excel-based reporting to Azure-based pipelines with outputs in Tableau and Looker Studio, saving ~5–6 hours daily.
  • Designed and managed data movement across Bronze, Silver, and Gold layers using the Medallion Architecture in Azure Databricks for clean, curated, and analytics-ready data.
  • Transformed and cleaned third-party API data in Databricks, storing outputs in Azure SQL and Data Lake.
  • Created and optimized data models, views, and materialized datasets in Azure Databricks and Azure SQL.
  • Automated recurring tasks and handled ad hoc reporting using Python, improving process efficiency and responsiveness.
  • Implemented Row-Level Security (RLS) in Looker Studio to ensure secure, role-based access to sensitive data.

Data Analyst

Whitehat Jr
08.2021 - 01.2022
  • Analyze data to derive business insights & actionables.
  • Create and maintain sales matrix/dashboards in Excel/Gsheets, Tableau and use them to drive Sales by coordinating with key stake holders.
  • Extract & Transform data using Python (PandaSQL) from Redshift and Load it to Gsheets dashboards.
  • Initiate and drive data automations by scheduling python scripts to support Dashboards.
  • Manage sales data validation processes and tools and investigate significant differences from what was previously reported.
  • Assist the central team in processing the incentives for the Sales team.
  • Python script to push the sales data to AWS S3 from Gsheets.
  • Collaborated with cross-functional teams to ensure data integrity and accuracy, resulting in better-informed decisions.

Integration Support Associate

Zocdoc
02.2019 - 08.2021
  • Maintain and Troubleshoot Synchronizers between Zocdoc & clients so as to optimize bookings.
  • Provide technical support by looking into the different practice management system of the clients, troubleshooting, performing Root cause analysis, and ensuring the synchronizers are functional and providers are bookable on Zocdoc.
  • Conduct Quality Assurance for processes and tasks. Ensuring accuracy is well above the set benchmarks for all process.
  • Pull relevant data using complex SQL queries(Redshift & Snowflake) and creating reports on G- sheets/Excel and Tableau. Analyzing the reports, identifying patterns, creating and driving actionable insights to ensure optimal provider bookability. This led to direct increase in bookings leading to direct impact on the companies revenue.
  • Collaborate with the different US teams with pivotal projects to gain different insights and optimize the project outcome.
  • Worked with US Healthcare Insurance(Medicaid/Medicare) datasets.

Education

Master of Science - Material Science & Applied Physics

Vellore Institute of Technology
Vellore
10-2017

Bachelor of Science - Physics

Fergusson College
Pune
06-2015

Technical Skills

Cloud & Storage:

  • Azure Data Factory
  • Azure Databricks
  • Azure Data Lake Storage
  • Azure SQL Database
  • Azure Synapse Analytics

Data Processing & ETL:

  • PySpark
  • Python (Pandas, NumPy)
  • REST API Integration
  • Medallion Architecture (Bronze–Silver–Gold Layers)

Data Modeling & Querying:

  • SQL (Azure SQL, Spark SQL)
  • String Manipulation, Regex, Fuzzy Matching
  • Partitioning & Clustering

Orchestration & Automation:

  • Azure Data Factory Pipelines & Triggers
  • Azure Functions
  • Job Scheduling (ADF/Databricks)

Visualization & BI Tools:

  • Looker Studio
  • Tableau
  • Dashboard Design & Data Storytelling

Security & Governance:

  • Row-Level Security (RLS)
  • Data Validation & Quality Checks
  • Access Controls & Permissions (Looker Studio, Azure)

Timeline

Senior Data Associate

Lloyds Technology Centre
01.2024 - Current

Data Analyst

Emeritus
01.2022 - 01.2024

Data Analyst

Whitehat Jr
08.2021 - 01.2022

Integration Support Associate

Zocdoc
02.2019 - 08.2021

Master of Science - Material Science & Applied Physics

Vellore Institute of Technology

Bachelor of Science - Physics

Fergusson College

Similar Profiles

CREATE PROFILE
Aniket Kulkarni