YAMINI PAPILLUGARI
Data Engineer
Hyderabad
Summary
Databricks Certified Data Engineer Associate with 3+ years of hands-on experience specializing in ETL processes. Designed and implemented 100+ data pipelines using Azure Databricks, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake Storage, and SQL Server, orchestrating data to drive insights and improve patient care by 40%. Expertise in writing efficient code using PySpark, optimizing ETL pipelines, fortifying data security, and crafting solutions that empower healthcare professionals with the knowledge they need to make informed decisions.
Overview
3
3
years of professional experience
5
5
Certifications
3
3
Languages
Work History
Team Lead
Modak Analytics
4 2023 - Current
- Created plans and strategies to achieve objectives involving organizing resources, assigning tasks, and establishing timelines
- Ensured free flow of information within the team and between other departments or stakeholders
- Motivated and inspired team members to perform at their best
- Represented the team in meetings, presentations, or discussions with other departments or external stakeholders.
- Directed and supervised team of 3 Members.
- Promoted a positive work environment by fostering teamwork, open communication, and employee recognition initiatives
- Enhanced overall team performance by providing regular coaching, feedback, and skill development opportunities
- Trained new team members by relaying information on company procedures and safety requirements
Data Engineer
Modak Analytics
12.2021 - 04.2023
- Designed and implemented data warehousing solutions using Snowflake, including schema design, data loading, and performance tuning, improving data accessibility and query performance
- Planned and developed data workflows utilizing Azure Databricks, automating ETL from Azure Data Lake Storage EDP to SQL Server, reducing processing time by 80% and enhancing data quality by 40%
- Implemented Delta tables for enhanced data management, achieving ACID compliance, versioning, and a 20% improvement in query performance compared to standard file formats
- Utilized Delta’s time travel feature for efficient data recovery and historical analysis
- Utilized Azure Data Lake Storage (ADLS) for streamlined data staging and intermediate storage, reducing data storage expenses by 25% while ensuring scalability and enhancing data accessibility.
05.2021 - 11.2021
- Orchestrated and implemented the near real-time data batch process, managing the ingestion of 100,000s of patient-provider appointment data from Kafka FHIR end-point into Microsoft SQL Server and Google Cloud Storage (GCS)
- Enhanced decision-making efficiency by 30% through ensuring the availability of effectively cleansed, curated, and aggregated data.
- Self-motivated, with a strong sense of personal responsibility
- Excellent communication skills, both verbal and written
- Skilled at working independently and collaboratively in a team environment
- Passionate about learning and committed to continual improvement
Education
Bachelor’s Degree in Computer Science Engineering -
Sree Vidyanikethan Engineering College
Tirupati, Andhra PradeshGrade 11 and 12 Education - undefined
Abhyas Junior College
Kadapa, Andhra PradeshSkills
SQL
Python
PySpark
Data Cleaning and Preparation
Data Analysis and Modeling
Data Quality Improvement
Data Governance
Disaster Recovery
Websites
Certification
Databricks Certified Data Engineer Associate
Accomplishments
- Awarded Best Team Player of the Quarter for on-time deliverables with 0 escalations.
- Received Modak Client appreciation from the Director of Technology for building an ETL framework to share client data securely.
Timeline
Data Engineer
Modak Analytics
12.2021 - 04.2023
05.2021 - 11.2021
Team Lead
Modak Analytics
4 2023 - Current
Bachelor’s Degree in Computer Science Engineering -
Sree Vidyanikethan Engineering College
Grade 11 and 12 Education - undefined
Abhyas Junior College
Similar Profiles
Suraj AkulaSuraj Akula
Data Engineer at Modak Analytics, SyngentaData Engineer at Modak Analytics, Syngenta
Rithik GandhariRithik Gandhari
Data Engineer at Modak AnalyticsData Engineer at Modak Analytics
Venkata Sai Kalyan Mahankali Venkata Sai Kalyan Mahankali null
Data Engineer at Modak AnalyticsData Engineer at Modak Analytics