Azure data Engineer with 5+ years of Software Development Life Cycle and Bigdata experience in various suits like Hive,SQL, Azure Data Factory, Azure Databricks, Azure Data Lake, AWS Glue, Snowflake, Airflow and Pyspark & Control-M.
Overview
6
6
years of professional experience
Work History
Senior Software Engineer
HCL Technologies
03.2022 - Current
Experience in Azure /AWS Could Data Analytics Platform.Experience in creating and branching ADF Pipelines, Experience in Monitoring Airflow DAGs and Databricks Streaming Jobs
Experience in Snowflake and AWS Glue.
Bulk loading from the external stage (AWS S3) to snowflake tables using the COPY command.
Experience in working with Azure Databricks notebook with Spark SQL and Python.
Expertise in the SQL Server designing a database and administration, patching, database maintenance.
Experience in Creating hive tables to store the processed results
Having good experience in Developing TSQL script and Stored Procedures.
Experience in Developing Shell scripting for Data loading Activities.
Experience in implementing MS SQL Server security and database permissions.
Ability to Installation, configuration and maintenance of MS SQL Server.
Experience in Implementation of Database maintenance plan, performing regular Backups and scheduling tasks.
Consultant
Standard Chartered GBS
01.2020 - 03.2022
Software Engineer
Mindtree
09.2018 - 12.2019
Education
Bachelor of Science -
NETS
Hyderabad, India
06.2015
Skills
Azure Data bricks
Azure Data Factory
Pyspark
AWS Glue
Snowflake
SQL Server
Hive
Shell Scripting
Airflow
Control-M
Python
skill set
Experience in Azure /AWS Could Data Analytics Platform.
Experience in creating and branching ADF Pipelines, Experience in Monitoring and retriggering Apache Airflow DAGs and Databricks Streaming Jobs
Experience in Snowflake and AWS Glue.
Bulk loading from the external stage (AWS S3) to snowflake tables using the COPY command.
Experience in working with Azure Databricks notebook with Spark SQL and Python.
Expertise in the SQL Server designing a database and administration, patching, database maintenance.
Experience in Creating hive tables to store the processed results
Having good experience in Developing TSQL script and Stored Procedures.
Experience in Developing Shell scripting for Data loading Activities.
Experience in implementing MS SQL Server security and database permissions.
Ability to Installation, configuration and maintenance of MS SQL Server.
Experience in Implementation of Database maintenance plan, performing regular Backups and scheduling tasks.
Top Clients
Ericsson
Standard Chartered
Timeline
Senior Software Engineer
HCL Technologies
03.2022 - Current
Consultant
Standard Chartered GBS
01.2020 - 03.2022
Software Engineer
Mindtree
09.2018 - 12.2019
Bachelor of Science -
NETS
Similar Profiles
Srinivasan NandagopalSrinivasan Nandagopal
ETL Lead /Onshore Technical Business Analyst at HCL Technologies India & HCL Technologies NZ LtdETL Lead /Onshore Technical Business Analyst at HCL Technologies India & HCL Technologies NZ Ltd