Sai Madhuri Rasamsetty
Summary
Results-driven Azure Data Engineer with over 9+ years of experience in designing, building, and optimizing scalable data pipelines and architectures across diverse industries. Proven expertise in data modeling, ETL development, and cloud data platforms with a strong focus on Azure technologies. Extensive experience in utilizing Microsoft Purview for data cataloging, classification, and compliance. Skilled in automating metadata scanning, ensuring data quality, and managing data classification across multiple Azure data sources to drive efficiency and maintain compliance
Overview
11
11
years of professional experience
1
1
Certification
Work History
Data Management Lead | Electrolux
Cognizant
01.2025 - Current
- To Register Azure Databricks Unity Catalog as a source for metadata scanning
- Configure and implement a Enterprise Data Catalog on Microsoft purview by integrating Databricks Workspaces, Tables, and Schemas for end-to-end visibility across the data landscape.
- Performed automated metadata scans on Databricks-managed data assets including Delta tables to support consistent documentation, lineage, and compliance reporting.
- Created Azure Databricks notebooks for analysis and metadata management, automating processes and enhancing documentation to provide better data insights and improve governance within the Databricks environment.
- Define custom classifications to identify sensitive data during metadata scanning
- Define and Implement data governance policies, standards, business glossaries through Bulk Import
Data Steward and Governance | Swedbank
Cognizant
06.2024 - 12.2024
- Created Application, Business, and Technical Lineage for various metrics within SWIC, leveraging Azure Data Engineering tools to map and ensure accurate data flow across systems.
- Developed Business Data Elements and Definitions of data elements, linking them to Business terms and Glossary terms, promoting better data understanding and consistency across the organization.
- Created Business Rules and identified critical Data Elements within the scope of the domain, ensuring data governance and alignment with business requirements in Azure-based platforms.
- Analyzed gaps in Business Lineage and linked Business elements to technical attributes in SWIC, utilizing Azure tools to bridge gaps and improve data clarity.
- Designed and implemented Global and Local Data Quality Rules, ensuring reliable data across systems while adhering to Azure's data governance best practices.
- Resolved data issues where possible, escalating when necessary, and proposing improvement activities to enhance data quality and governance on Azure platforms.
- Analyzed Group Data Warehouse code logic, deriving technical lineage and mapping rules, using Azure Data Engineering solutions to ensure the correct representation of data transformations and flows.
- Applied strong knowledge of data governance principles, metadata management, data quality, and data stewardship concepts to ensure best practices are followed for Azure-based data environments.
Data Engineer/ETL Developer | Volvo Cars
Cognizant
12.2021 - 05.2024
- Domain Lead for MSS (Marketing and Sales Services) & GOSAP, Finance area
- Maintenance of various inbound and outbound data pipelines (Sales, Finance, COC etc.)
- Designed and implemented scalable data pipelines using Databricks and Apache Spark, enabling efficient extraction, transformation, and loading (ETL) of data into Azure Data Lake Storage and other Azure services.
- Developed and maintained secure data warehouses and lakehouses by applying best practices in data modeling, quality checks, and governance to ensure accurate and reliable data across platforms.
- Integrated AI/ML models into data pipelines using Databricks ML and Azure ML, enhancing predictive analytics capabilities and driving business insights.
- Collaborated with cross-functional teams, including data scientists, business analysts, and DevOps engineers, to implement successful data platform solutions and ensure alignment with business requirements.
- Worked on permanent fixes of production job failures to improve performance
- Worked on Azure Devops to manage Product backlog items (PBI) to monitor change requests
Data Engineer | Bank of America
Tata Consultancy Services
04.2014 - 12.2021
- Involved in all phases of SDLC, detailed Analysis-Design documents with source to target mapping
- Wrote BTEQ scripts in Teradata to transform data
- Worked on Teradata utilities Fast load, Multiload to load data into tables
- Used various Teradata Index techniques to improve query performance
- Worked on writing test cases and building up complex queries in Teradata
- Used different stages of DataStage Designer like Lookup, Join, Merge, Funnel, Filter, Copy, Aggregator, and Sort
- Hands on experience on Unified Data Analytics with Databricks, Databricks Workspace User Interface, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL
- Experience in writing numerous Teradata SQL queries by creating SET or MULTISET table, Views, Volatile tables, using Inner and Outer joins
- Created Multiset, temporary, derived, and volatile tables in Teradata database
- Implemented Indexes, collecting statistics and constraints while creating tables
Education
Mechanical Engineeting
M.V.G.R College of Engineering
Skills
- Friendly, positive attitude
- Teamwork and collaboration
- Customer service
- Problem-solving
- Azure Databricks
- Apache Spark
- Azure Data Lake Storage
- Databricks Notebooks
- Delta Lake (Python & Spark SQL)
- ETL Pipeline Design
- Azure Machine Learning
- Data Governance & Metadata Management
- SQL & PySpark
- Performance Tuning & Optimization
Certification
· Azure Fundamental AZ 900 (Microsoft Certified)
Timeline
Data Management Lead | Electrolux
Cognizant
01.2025 - Current
Data Steward and Governance | Swedbank
Cognizant
06.2024 - 12.2024
Data Engineer/ETL Developer | Volvo Cars
Cognizant
12.2021 - 05.2024
Data Engineer | Bank of America
Tata Consultancy Services
04.2014 - 12.2021
Mechanical Engineeting
M.V.G.R College of Engineering
Similar Profiles
Navya VootlaNavya Vootla
Associate at CognizantAssociate at Cognizant
Maulik ModiMaulik Modi
Sr. Associate at CognizantSr. Associate at Cognizant
Vyshali Santhosh KumarVyshali Santhosh Kumar
Support Engineer at CognizantSupport Engineer at Cognizant
Tejas HireTejas Hire
Associate at CognizantAssociate at Cognizant
Prashant KumarPrashant Kumar
<ul><li>Roles and Responsibilities</li><li>Hiring and team building</li><li>Managing team’s career progression and performance reviews</li><li>Managing Performance improvement plan and firing</li><li>Mentoring</li><li>Product roadmap planning and execution</li><li>Accountability of the entire delivery execution including the risk mitigation planning.</li><li>Stakeholder management</li><li>Adhering to Apple Privacy and Security Guidelines for platform</li><li>Design and implementation of new architectures and solutions to manage all online services for AdXchange in Apple Ads.</li><li>Design and implementation of new architectures and solutions deliver Budget experimentation in Apple Ads</li><li>Design and implementation of new architectures and solutions to manage data for Ad Platform.</li><li>Creating and maintaining all the data and analytics and revenue pipelines for Ad Platforms</li><li>Driving the solution for data ingestions and data processing across Ad platform</li><li>Defining the Strategy for data governance and data access</li><li>Collaboration with business to deliver relevant data and insight for our strategy and decisions.</li><li>Managing storage, processing, copy/synchronization etc. appropriate to scale</li><li>Enabling machine learning and algorithm groups by proving them right frameworks and data</li><li>Advancing team’s design methodology and quality programming practices and evangelize those techniques across Ad platform.</li><li>Deliveries</li><li>Setup 8+ member team to design and deliver Budget Allocation and Budget experimentation.</li><li>Leading Ad Delivery services team, responsible for delivering various capabilities like query understanding, targeting, fraud etc.</li><li>Delivered and Lead Design for observability for budget, and data platform in Ad platform.</li><li>Setup 11+ members high performing team to handle various business needs such as analytics and micro services for Display Advertising as well as Data Platform</li><li>Instrumental in driving Data Platform throughout the SDLC from inception, design, development, testing and deployment.</li><li>Instilled a strong team culture of high-quality delivery by constructive feedback, cross collaboration, focus and motivation.</li><li>Delivered Realtime and Batch Platform with various integrations</li><li>Delivered new DIP design for Data Platform</li><li>Delivered design of all the components of Data processing platform</li><li>Transitioned Display data work to India seamlessly and delivered many critical business impacting features and organizational security initiatives.</li><li>Closely worked with various stakeholders to understand the requirements which resulted into efficient remote work culture.</li><li>Seamless Display execution and set up best practices for 24X7 production on-call.</li><li>Tools and Technologies</li><li>AWS, S3, Kafka, Spark, Hadoop, EMR, Hive, Scoop, Flume, Cassandra, Airflow, Oozie, Gobblin, Schema Store, Icloud, Grafana, Kubernetes, Vertica, Alation, snowflake, druid, Iceberg, Java, Scala, IntelliJ, Oracle, MySql, Git, RIO, Spinnaker, Elastic cache, Grpc, Agile.</li></ul> at Apple - Adplatform<ul><li>Roles and Responsibilities</li><li>Hiring and team building</li><li>Managing team’s career progression and performance reviews</li><li>Managing Performance improvement plan and firing</li><li>Mentoring</li><li>Product roadmap planning and execution</li><li>Accountability of the entire delivery execution including the risk mitigation planning.</li><li>Stakeholder management</li><li>Adhering to Apple Privacy and Security Guidelines for platform</li><li>Design and implementation of new architectures and solutions to manage all online services for AdXchange in Apple Ads.</li><li>Design and implementation of new architectures and solutions deliver Budget experimentation in Apple Ads</li><li>Design and implementation of new architectures and solutions to manage data for Ad Platform.</li><li>Creating and maintaining all the data and analytics and revenue pipelines for Ad Platforms</li><li>Driving the solution for data ingestions and data processing across Ad platform</li><li>Defining the Strategy for data governance and data access</li><li>Collaboration with business to deliver relevant data and insight for our strategy and decisions.</li><li>Managing storage, processing, copy/synchronization etc. appropriate to scale</li><li>Enabling machine learning and algorithm groups by proving them right frameworks and data</li><li>Advancing team’s design methodology and quality programming practices and evangelize those techniques across Ad platform.</li><li>Deliveries</li><li>Setup 8+ member team to design and deliver Budget Allocation and Budget experimentation.</li><li>Leading Ad Delivery services team, responsible for delivering various capabilities like query understanding, targeting, fraud etc.</li><li>Delivered and Lead Design for observability for budget, and data platform in Ad platform.</li><li>Setup 11+ members high performing team to handle various business needs such as analytics and micro services for Display Advertising as well as Data Platform</li><li>Instrumental in driving Data Platform throughout the SDLC from inception, design, development, testing and deployment.</li><li>Instilled a strong team culture of high-quality delivery by constructive feedback, cross collaboration, focus and motivation.</li><li>Delivered Realtime and Batch Platform with various integrations</li><li>Delivered new DIP design for Data Platform</li><li>Delivered design of all the components of Data processing platform</li><li>Transitioned Display data work to India seamlessly and delivered many critical business impacting features and organizational security initiatives.</li><li>Closely worked with various stakeholders to understand the requirements which resulted into efficient remote work culture.</li><li>Seamless Display execution and set up best practices for 24X7 production on-call.</li><li>Tools and Technologies</li><li>AWS, S3, Kafka, Spark, Hadoop, EMR, Hive, Scoop, Flume, Cassandra, Airflow, Oozie, Gobblin, Schema Store, Icloud, Grafana, Kubernetes, Vertica, Alation, snowflake, druid, Iceberg, Java, Scala, IntelliJ, Oracle, MySql, Git, RIO, Spinnaker, Elastic cache, Grpc, Agile.</li></ul> at Apple - Adplatform