Yoga
Ashwini Macherla
GCP Data Engineer
Hyderabad
Summary
Accomplished GCP Data Engineer by enhancing data quality and optimizing ETL pipelines at Coforge. Skilled in GCS, BigQuery, Airflow, SQL and Python, with a knack for fostering collaborative environments. To seek and maintain full-time position that offers professional challenges utilizing interpersonal skills, excellent time management and problem-solving skills.
Overview
6
6
years of professional experience
4
4
years of post-secondary education
Work History
GCP Data Engineer
COFORGE
Hyderabad
04.2022 - Current
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
- Evaluated various tools, technologies, and best practices for potential adoption in company's data engineering processes.
- Collaborated with cross-functional teams for seamless integration of data sources into company's data ecosystem.
- Provided technical guidance and mentorship to junior team members, fostering a collaborative learning environment within organization.
- Estimated work hours and tracked progress using Scrum methodology.
Big Data Hadoop Developer
Capgemini
Hyderabad
08.2021 - 04.2022
- Created multiple hive tables for different sources and targets, few tables to store processed intermediate results.
- Created and modified several hive queries to identify missing transactions and to provide reconciliation between source and their respective targets.
- Successfully investigated exceptions causing reasons, fixed them and re-ran rec-pair using Control-M.
- Identified, analyzed and interpreted trends and patterns that are causing exceptions and made reports accordingly in order to fix them.
- Successful in implementing multiple change requests and deployed them using Jenkins pipelines.
- Monitored results for each and every rec-pair using Qliksense tool on monthly basis
- Estimated work hours and tracked progress using Scrum methodology.
Spark Developer
TCS
Hyderabad
12.2019 - 07.2021
- Boosted query response times by leveraging broadcast variables for efficient data sharing across executor nodes in distributed environment.
- Improved query performance with implementation of partitioning and bucketing techniques in Spark SQL.
- Developed GBI and AMP frameworks to replicate data between clusters.
- Created Autosys jobs, which will trigger Spark lighter script and promotes them to various environments.
- Created various processes using Filos, that enqueue batches for table exports.
- Responsible for creating mock-up data in GBI test cluster, that will move to AMP cluster during test jobs.
- Responsible for triggering AMP production jobs and validated using Jupyter Notebook.
- Created Hubble charts and collected all stats for both GBI and AMP systems.
- Estimated work hours and tracked progress using Scrum methodology.
Manual Tester
TCS
Kolkata
07.2018 - 10.2019
- Improved software quality by meticulously executing TCS BaNCS applications and manual test cases and identifying defects.
- Executed test scripts, logged defects using FileZilla and worked to resolve issues noted in testing process.
- Collaborated with development team to diagnose and resolve software issues in timely manner.
- Responsible for generating letters using Thunderhead and ensured that they met spec.
- Performed code review.
- Identified functional gaps in end-to-end applications by performing manual testing.
- Worked extended hours when necessary to meet deadlines.
Education
Bachelors of Technology - Electronics And Communication Engineering
BVR Institute of Technology
Narsapur 10.2013 - 05.2017
Skills
GCS, BigQuery, Cloud composer, Pub/Sub
Apache Spark, Hive, Hadoop
SQL, Python
Windows OS, Mac OS, Linux
Jenkins, GitHub, Qliksense
CSV, JSON, XML, AVRO, Parquet
Sprint, Scrum, JIRA, Confluence
Interests
Listening songs
Timeline
GCP Data Engineer
COFORGE
04.2022 - Current
Big Data Hadoop Developer
Capgemini
08.2021 - 04.2022
Spark Developer
TCS
12.2019 - 07.2021
Manual Tester
TCS
07.2018 - 10.2019
Bachelors of Technology - Electronics And Communication Engineering
BVR Institute of Technology
10.2013 - 05.2017
Similar Profiles
Manisha MadhuManisha Madhu
Functional Business Analyst at COFORGEFunctional Business Analyst at COFORGE
Anthony ChildsAnthony Childs
Help Desk Support at CoforgeHelp Desk Support at Coforge
NITIN BHANDARINITIN BHANDARI
Technology Specialist at CoforgeTechnology Specialist at Coforge