Hello, I am
RAHUL PATEL.
1
Excel Project
2
PowerBI Projects
1
SQL Project
1
Python Project
About Me
Welcome! I’m Rahul Patel, a Data Engineer with 3+ years of experience specializing in Azure and AWS Cloud Data Engineering. I am passionate about transforming complex datasets into actionable insights that drive strategic business decisions.
With expertise in SQL, Python, PySpark, Power BI, and Excel, I design and optimize ETL pipelines, data warehouses, and real-time data solutions. In my professional role at Nexgen Tech Solutions and HCLTech, I have worked on high-volume, real-time analytics projects, integrating diverse datasets and enhancing data management efficiency.
Beyond my work, I have completed several independent projects that showcase my ability to turn raw data into clear insights. I am committed to continuous learning and leveraging data to solve real-world challenges. Explore my work and connect to discuss impactful data-driven solutions!
Key Skills
Effective Communication
Stackholder Mangement
SQL
Python
ETL
Dashboards
Data Cleaning
Preprocessing
Statistics
Data Modeling
Data Warehousing
Azure Cloud Data Engineering
My Projects
My Experience
Data Engineer – Nexgen Tech Solutions
Feb 2025 – Present | Noida
Client: HDFC Bank – Digital Banking & Analytics
-
Contributed as a Data Engineer in developing real-time ingestion pipelines using Kafka and Pub/Sub, enabling seamless processing of high-volume banking transactions.
-
Enhanced a 3-layer Delta Lakehouse (Staging–Curated–Service) in Azure Databricks, improving scalability, security, and analytics readiness.
-
Implemented complex PySpark transformations to support Net Banking & Mobile Banking analytics, driving accuracy in transaction-level reporting.
-
Applied data governance, security, and compliance standards to ensure regulatory adherence in financial data pipelines.
-
Optimized Databricks and Azure Data Factory (ADF) workflows, achieving cost savings and reduced pipeline runtimes.
-
Collaborated with cross-functional teams (Data Architects, Analysts, QA) to deliver banking-ready, high-quality datasets for BI dashboards and compliance reporting.
Data Engineer – HCLTech
Oct 2022 – Jan 2025 | Noida
Project: Microsoft Bing Data Analytics & Engineering
-
Processed and analyzed 1TB+ of big data generated daily by Microsoft Bing, designing and deploying scalable ETL pipelines and robust data models.
-
Improved real-time analytics and visualization using Azure Data Lake, Databricks, Apache Spark, and Power BI.
-
Optimized ADF workflows, reducing data processing time by 30%.
-
Integrated and modeled complex datasets from multiple sources, increasing data accuracy by 20%.
-
Designed and implemented scalable cloud-based solutions using Azure Synapse Analytics, reducing system downtime by 15%.
-
Collaborated with cross-functional teams across geographies to deliver business-critical insights.
Awards & Certificate
Let's Connect
Feel free to get in touch with me. I am always open to discussing new projects, creative ideas or opportunities to be part of your visions.