2.5 years of total experience in Healthcare domain projects.My role has involved the creation of data pipelines and the execution of ETL processes, primarily leveraging the capabilities of Azure Databricks. I am adept at refining data, executing processing tasks using my proficiency in programming languages, including Python, SQL, and PySpark. Also worked on Azure & Snowflake cloud platform.
Understanding the requirements from stakeholders and took the ownership of the product end to end. Worked along side with team and successfully delivered the product on time.
Developed and maintained the ETL pipeline end-to-end in Scala spark using Azure Databricks and Azure platform.
Data Loading from Azure blob storage into Snowflake Schemas using storage integration and external stage and Snow pipes.
Experience in developing Snowflake stored procedures with expertise in SQL and JavaScript.
Tools and Technologies Used: Snowflake, Scala, Spark, SQL, Azure Databricks, Delta Lake, Azure SQL, Python.
Programming Languages-:
Java, Python, SQL, Scala
Big Data Tools-: Spark, SQL, PySpark, Hive, Data Modeling
Cloud Tools-: Snowflake, Azure Databricks, Azure Storage Accounts, Azure Datalake, Azure SQL, Delta Lake