State Street · Boston, MA · Contract

• Designed and implemented ELT pipelines using PySpark and Databricks, replacing legacy batch jobs with modular, testable Python-based transformation layers.
• Reduced data retrieval latency by 25% through optimized Spark caching strategies and restructured Snowflake query patterns.
• Built a granular role-based data access layer integrated with enterprise authentication, enforcing compliance across all financial ELT pipelines.
• Mentored two junior engineers on PySpark performance patterns, modular code design, and pipeline observability.

Verizon · Irving, TX · Contract

• Increased pipeline throughput by 40% by re-architecting from batch processing to a real-time Kafka-based ELT streaming model.
• Designed and deployed Airflow DAGs to orchestrate multi-stage ELT workflows across Kafka, AWS, and BigQuery.
• Implemented robust Kafka checkpointing and event re-processing logic, eliminating intermittent data loss.
• Prototyped a Generative AI workflow to summarize system logs, enabling faster root-cause analysis for on-call engineers.

Motivity Labs · Hyderabad, India · Full-time

• Designed ELT data models in Snowflake to consolidate customer records from disparate relational sources into a single unified view.
• Built and maintained Airflow DAGs to orchestrate daily ELT jobs, including extraction, validation, and load sequencing.
• Improved lead conversion accuracy by 15% through automated data quality validation scripts catching schema drift and null anomalies.

Ramco Systems · Chennai, India · Full-time

• Automated daily report extraction from legacy PostgreSQL databases using Python ELT scripts, saving ~10 hours of manual work per week.
• Mapped and validated legacy schema fields to target warehouse structures, writing integrity tests for accurate migration.
• Documented database schemas, data flow processes, and transformation logic for long-term maintainability.