Himanshu Sharma

Lead Data Engineer

Indore, IN.

About

Highly accomplished Lead Data Engineer with 12+ years of expertise in architecting and delivering scalable data platforms on Azure, including ADF, Databricks, and Delta Lake. Proven leader in end-to-end data engineering initiatives, driving CI/CD adoption, and delivering high-performance lakehouse architectures that translate complex business requirements into robust analytics solutions for healthcare and enterprise domains.

Work

Vdart Digital Pvt. Ltd. (ALDAR)

|

Lead Data Engineer

Dubai, Dubai, United Arab Emirates

→

Summary

Spearheaded the end-to-end architecture and delivery of a robust enterprise Medallion lakehouse, leveraging ADF and Databricks to support over 100 downstream analytics workloads across 50+ diverse data sources.

Highlights

Mentored a team of 4 junior data engineers on PySpark best practices, Delta Lake optimization, and Unity Catalog governance, resulting in a 30% improvement in team velocity and project delivery.

Championed CI/CD pipeline adoption and enforced stringent data quality standards across the platform, successfully reducing production incidents by 40% through comprehensive automated testing and monitoring.

Architected a metadata-driven ETL framework for ingesting diverse data sources including REST APIs (Zoho, LinkedIn, Salesforce), SFTP, SQL Server, and SAP, implementing SCD Type 2 for 15+ critical domain tables with full and incremental load strategies.

MERCK GROUP

|

Senior Specialist (GPDS)

N/A, N/A, India

→

Summary

Directed the successful implementation of a healthcare lakehouse leveraging ADF, Databricks, and Delta Lake, processing critical clinical trial data for over 200 users and achieving a 40% reduction in manual reporting efforts.

Highlights

Architected and implemented Unity Catalog governance across 100+ Databricks assets, ensuring stringent GxP compliance and empowering 50+ analysts with self-service analytics capabilities.

Collaborated with business stakeholders to design and curate 20+ critical clinical datasets, integrating them with Power BI and Tableau to significantly enhance KPI visibility and inform strategic portfolio decisions.

ALTEN CALSOFT LABS

|

Senior Software Engineer

N/A, N/A, India

→

Summary

Managed and resolved Customer Found Defects (CFD) following software updates, leveraging Azure Databricks to ensure system stability and performance.

Highlights

Orchestrated the resolution of Customer Found Defects (CFD) post-software updates, utilizing Azure Databricks to diagnose and rectify issues, enhancing product reliability.

Provided technical support for the Salesforce Customer Success Platform, implementing a cloud-based Lakehouse architecture that significantly improved user engagement and data accessibility.

YASH TECHNOLOGIES

|

Software Engineer

N/A, N/A, India

→

Summary

Translated complex business needs into precise technical requirements, leading comprehensive business analysis projects from initial conception through to successful implementation and delivery.

Highlights

Spearheaded the translation of intricate business requirements into actionable technical specifications, guiding complex business analysis projects through their entire lifecycle from conception to successful delivery.

Education

Medicaps Institute of Technology & Management

Indore, MP, India
→
B.E. Computer Science Grade: 71.03%

SICA School Indore

Indore, MP, India
→
12th Grade Secondary Education Grade: 76.6%

SICA School Indore

Indore, MP, India
→
10th Grade Primary Education Grade: 75.6%

Skills

Data Engineering & Architecture

Data Engineering, Azure Lakehouse Architecture, Delta Lake, Medallion Architecture, Data Modeling, SCD Type 2, Metadata-driven ETL, Enterprise Data Strategy.

Cloud Platforms

Azure Cloud, Azure Data Factory (ADF), Azure Databricks, ADLS Gen2, Unity Catalog.

Programming & Databases

PySpark, Python, SQL, REST APIs, SFTP.

Business Intelligence & Visualization

Power BI, Tableau.

DevOps & Practices

CI/CD, DevOps.

Data Governance & Quality

Data Governance, Data Lineage, MS Purview, Data Quality, Operational Lineage, GxP Compliance.

CRM & ERP Systems

Salesforce, SAP.

Specialized Tools

Palantir Foundry.

Leadership & Management

Team Leadership, Stakeholder Management, Mentoring, Project Management, Business Analysis.

Domain Expertise

Clinical Data, Healthcare Domain.