Omschrijving

Lead Data Engineer with 9+ years of experience building reliable and scalable data platforms across AWS and modern big data stacks.

I help companies design and implement production-grade data pipelines, real-time streaming systems, and analytics-ready data warehouses using technologies like Spark, Databricks, Python, SQL, and Airflow.

I’ve led data engineering teams and delivered large-scale data solutions for global companies including EPAM Systems and Intuit, working with high-volume datasets and complex data ecosystems.

My expertise includes ETL architecture, data platform design, pipeline performance optimization, and cloud-native data engineering on AWS and Azure.

Currently exploring LLM-driven data workflows, RAG architectures, and AI-augmented data platforms.

Available for remote freelance projects, consulting, and short-term engagements across Europe with European startups and data teams.

Talen

Engels
Tweetalig / moedertaal
Hindi
Tweetalig / moedertaal

Voorkeuren voor werkplek

Uitsluitend remote

Werkt voornamelijk remote

EPAM Systems
Lead Data Engineer
DIGITAAL BUREAU & IT-CONSULTANCY
februari 2024 - Vandaag (2 jaren en 4 maanden)
Sofia, SF, Bulgaria
I lead a team managing marketing data pipelines, bringing data from various sources into AWS, and constructing data marts to enhance data analysis capabilities. I played a crucial role in architecting the overall data strategy for the marketing data platform, utilizing Databricks, Spark, Python, SQL, Airflow, AWS EMR, Lambda, S3. Learning & creating POCs on LLM.
Databricks Python SQL Microsoft Azure DevOps
Intuit
Senior Software Engineer
september 2021 - februari 2024 (2 jaren en 5 maanden)
Bengaluru, Karnataka, India
I led a team of engineers in architecting and building robust Spark ETL data pipelines on AWS for loyalty and audit data preparation. My role involves designing and developing scalable data architecture, ensuring efficient data processing using technologies like Databricks, Spark, Python, SQL, Airflow, AWS EMR, Lambda, and S3.
Apache Spark Apache Kafka SQL Python Amazon Web Services
Reliance Jio
Deputy Manager
TELECOMMUNICATIE
augustus 2020 - september 2021 (1 jaar en 1 maand)
Kolkata, West Bengal, India
developed Spark streaming pipelines to process application logs, enabling real-time monitoring of application health. I primarily worked with Scala, Python, and SQL to deliver effective data processing solutions.
Scala SQL Python Apache Kafka Elasticsearch