Hi, I’m
Pabitra Kumar Sahu
Summary
Experienced Databricks/Cloud Developer with over 8+ years of IT experience in Microsoft Azure, Databricks, and Big Data platforms. Hands-on in designing scalable data pipelines, building ETL frameworks, implementing business logic using PySpark, and working with Azure-native services. Currently working with HCL Tech onsite for IKEA Sweden, focused on enterprise data lakehouse solutions.
Overview
8
years of professional experience
Work History
HCL Sweden AB – IKEA & Inter-IKEA
Senior Databricks Developer
05.2024 - Current
Job overview
- Joined IKEA engagement via HCL on May 27, 2024; onsite deputation to Sweden from Dec 1, 2024.
- Designed and managed advanced pipelines using Databricks, DLTs, AutoLoader, PySpark, and ADF.
- Built data ingestion from SharePoint and OneDrive into bronze/silver layers.
- Implemented pull and push mechanism to ingest data into bronze, silver, and gold layers using Delta Lake and structured streaming.
- Built a reusable metadata-driven framework to streamline development across ingestion, transformation, and orchestration stages.
- Led cost monitoring, identity management using service principals and SDKs.
- Led integration of RESTful APIs, enhancing communication between systems and improving user experience.
- Mentored junior developers, fostering skill growth and promoting best coding practices within the team.
ITC Infotech – IKEA & Inter-IKEA Systems B.V (Europe)
Senior Cloud Data Engineer
04.2021 - 05.2024
Job overview
- Migrated legacy ETL to modern architecture using Azure Databricks & ADF.
- Developed DLT pipelines for batch/streaming use cases.
- Built reusable data quality framework used across teams, reducing delivery by 2 sprints.
- Automated job monitoring with Log Analytics and cost reporting per subscription.
- Developed robust ETL pipelines for data integration across multiple platforms.
ITC Infotech – Allica Bank (UK)
Cloud Data Engineer
04.2020 - 03.2021
Job overview
- Built ingestion pipelines using Azure Data Factory & Databricks from SQL Server to ADLS.
- Created Hive scripts for KPI calculations displayed in Power BI.
- Implemented CDC and daily load strategies across pipelines.
- Designed and implemented data pipelines to ensure efficient data flow across systems.
ITC Infotech – Premier Insurance Brokers (UK)
Big Data Developer
01.2019 - 04.2020
Job overview
- Developed an ETL framework using Scala in Databricks and orchestrated with ADF.
- Applied Spark transformations for large-scale financial data sets.
- Developed scalable data processing solutions utilizing Hadoop and Spark frameworks.
United Health Group (XL Health) – USA
Data Engineer
09.2016 - 09.2017
Job overview
- Built Spark jobs using Scala and Hive to clean and preprocess healthcare data.
- Developed reusable components for transformation workflows.
Collabera Technologies – Federal Health Insurance Program (USA)
Data Engineer
07.2015 - 09.2016
Job overview
- Ingested and processed semi-structured data using Pig and Hive in Hadoop.
- Integrated MapReduce outputs into HBase for backend reporting.
Education
SDMIT Ujire
Bachelor of Engineering from Electronics & Communication Engineering
05.2014
University Overview
VTU Karnataka
Skills
- Cloud & Data Platforms: Azure Data Factory, Databricks (DLTs, AutoLoader, Unity Catalog, Workflows, Delta Lake, Lakehouse Architecture, Databricks SQL, DBUtils, Cluster Policies), Data Lake Gen1/Gen2, Synapse, SQL DB, Data Flow, Key Vault, Logic Apps, Log Analytics, Service Bus, Azure Monitor, Azure AD, Cost Management
- Big Data Technologies: Apache Spark, PySpark, Hadoop, Hive, Pig, Kafka, Sqoop, HDInsight, MapReduce
- API integration
- Languages: Python, SQL, KQL
- Databases: MySQL, Azure Synapse Analytics
- Tools & DevOps: Azure DevOps, GitHub, Git, CI/CD Pipelines, Jira, Confluence, DevOps Boards
Accomplishments
- Outstanding Performance – ITC Infotech (2020, 2022)
- Pat on the Back – ITC Infotech (2019)
Timeline
Senior Databricks Developer
HCL Sweden AB – IKEA & Inter-IKEA
05.2024 - Current
Senior Cloud Data Engineer
ITC Infotech – IKEA & Inter-IKEA Systems B.V (Europe)
04.2021 - 05.2024
Cloud Data Engineer
ITC Infotech – Allica Bank (UK)
04.2020 - 03.2021
Big Data Developer
ITC Infotech – Premier Insurance Brokers (UK)
01.2019 - 04.2020
Data Engineer
United Health Group (XL Health) – USA
09.2016 - 09.2017
Data Engineer
Collabera Technologies – Federal Health Insurance Program (USA)
07.2015 - 09.2016
SDMIT Ujire
Bachelor of Engineering from Electronics & Communication Engineering
Similar Profiles
Puneet TrehanPuneet Trehan
Engineering Manager at IKEA of Sweden ABEngineering Manager at IKEA of Sweden AB
GOMATHI SANKAR RAJENDRANGOMATHI SANKAR RAJENDRAN
Solution Architect | Product Owner | Agile Lead at IKEA Supply Services (Sweden) ABSolution Architect | Product Owner | Agile Lead at IKEA Supply Services (Sweden) AB
NEETU KapasiNEETU Kapasi
South Asia Head Corporate Affairs & Stakeholder Relations at IKEA Supply South Asia, Inter IKEA GroupSouth Asia Head Corporate Affairs & Stakeholder Relations at IKEA Supply South Asia, Inter IKEA Group
Archana SharmaArchana Sharma
Database and Azure Databricks ETL Developer at R1 RCMDatabase and Azure Databricks ETL Developer at R1 RCM
RAVI SANKAR PATIRAVI SANKAR PATI
PySpark,Azure DataBricks,Native HANA Developer at UST GlobalPySpark,Azure DataBricks,Native HANA Developer at UST Global