Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Baladari Venkata Kanaka Varshini

Hyderabad

Summary

Data Engineer with Experience in Banking Domain. Well acquainted with Big Data tool stack distributed Computing and Data Structures. Certified as Azure Data Engineer and gained good hands-on experience with ADLS, Azure Synapse Analytics, ADF. Strong Desire to move forward and expand skill set.

Overview

3
3
years of professional experience
1
1
Certification

Work History

Data Engineer – PySpark Developer

IBM
03.2022 - Current

Project:

This Project is Digitizing forms for customers self-servicing/banker to create request on behalf of the customer. The solution is to listen to the forms data from Kafka topics in real-time and store the data as is in the HBase Cluster

Responsibilities:

  • Worked with DDEP Framework as DDEP Engineer, performed data transformation logic to process data from HBase using pyspark which involves inbound, transform and outbound layers
  • Created table metadata schema using macro enabled CSV in development level of project
  • Added new tables to schema in Hive and updated the code and column mapping for those tables in python
  • Scheduled and automated batch jobs using Control-M for loading data from source to target (Hive tables)
  • Debugging failed jobs and providing analysis and solution based on error
  • Performed ST, UT on jobs deployed to SIT environment
  • Validated data in target tables during testing phase
  • Push/pull code to Bitbucket repository using Git commands and Visual Studios
  • Attending scrum calls with onsite teams and discussing on project flow
  • Involved in various documentation for test results
  • Created IFS Pages containing Table details in Confluence

Environment:

  • Hive, HBase, PySpark, HDFS, Python, Shell Scripting, Jenkins, Bitbucket, JIRA, BMC Control-M, Atlas

Front- End Developer

Self Employed Web
10.2021 - 02.2022

Project:

  • Web development project where developed web page to calculate retirement savings of individual based on various factors such as income, expenditure and loans for period and provide detailed summary of their money management after retirement age

Responsibilities:

  • Coded using HTML, CSS and JavaScript to develop features for both mobile and desktop platforms.
  • Utilized version control systems such as Git to track changes throughout development process.

Environment:

  • HTML, CSS, Visual Studio Code, Azure DevOps.

Education

Bachelor of Technology - Electronics & Communication

Raghu Instituteof Technology
Visakhapatnam
06.2021

Skills

Big Data Processing:

  • Apache Spark, PySpark, Spark SQL, HDFS, Hive, HBase
  • ETL development (Informatica)
  • Data Pipeline Design
  • Technical Support

Technologies/ Frameworks:

  • Languages: C, SQL, Python, Core Java, Scripting Languages
  • Web Technologies:HTML5, CSS, JSON
  • Databases: Oracle, MYSQL
  • Operating Systems: Windows, Unix , Cloud era, puTTy
  • Automation Tool: BMC Control-M
  • IDE(s): Eclipse, Visual Studio, Visual Studio Code, PyCharm
  • CI/CD Tools: Jenkins, Azure DevSecOps
  • Code Version Control: Bit Bucket, GitHub
  • Business Story Documentation: JIRA, Confluence
  • Cloud Skills: Good knowledge on cloud technologies like ADF, ADLS, Databricks

Certification

  • Azure Data Engineer Associate (DP-203)
  • Azure Fundamentals (AZ-900)
  • Data Fundamentals (DP-900)

Timeline

Data Engineer – PySpark Developer

IBM
03.2022 - Current

Front- End Developer

Self Employed Web
10.2021 - 02.2022

Bachelor of Technology - Electronics & Communication

Raghu Instituteof Technology
Baladari Venkata Kanaka Varshini