💻 About Me: Senior Data Engineer

Hello! 👋
I’m Santosh Kumar Gouda, a Senior Data Engineer with 8.5+ years of experience architecting cloud-native data solutions. I transform complex data challenges into scalable, cost-efficient systems—proven by 40%+ performance gains across multiple enterprises.

🛠️ Technical Arsenal

🧰 Core Stack

💼 Professional Journey

🚀 Data Analytic Tech Lead

📍 Sears Global Technologies | Nov 2022 - Present | Pune

• Engineered Snowflake ingestion pipelines from OLTP systems (MySQL/PostgreSQL/MongoDB) and S3/SFTP, achieving 30% faster data delivery
• Automated 200+ ETL workflows using Apache Airflow, reducing manual intervention by 40% with 99% on-time delivery
• Designed complex SQL queries for ad-hoc analytics, maintaining 98% stakeholder satisfaction
• Implemented data quality frameworks that reduced pipeline failures by 35%

🔧 Data Engineer

📍 Enkash | May 2022 - Sep 2022 | Bangalore

• Built AWS Glue/PySpark pipelines to migrate on-prem MySQL → Redshift, cutting processing time by 40%
• Developed advanced Glue scripts optimizing transformation logic, reducing job runtime by 25%
• Created interactive QuickSight dashboards serving 200+ business users with real-time sales insights

🔧 Data Engineer

📍 Tech Mahindra | May 2021 - May 2022 | Bangalore

• Consolidated 1TB+ disparate data sources using AWS Glue/S3, enabling unified analytics
• Automated data reconciliation with Python, achieving 90% accuracy improvement and saving 20+ hours/week
• Enhanced ETL performance reducing data wrangling time by 40%

🔧 Data Engineer

📍 Alten India | Sep 2020 - Apr 2021 | Bangalore

• Migrated legacy SSIS packages → Azure Databricks, slashing ETL runtime by 35%
• Developed Azure Data Factory pipelines integrating Blob Storage → Data Warehouse, boosting efficiency by 50%

🔧 Data Analytics Engineer

📍 Bristlecone | Nov 2019 - Sep 2020 | Bangalore

• Architected data management framework reducing retrieval time by 25%
• Processed 500K+ records/day into Azure Data Lakes, improving accessibility by 30%

🔧 Data Analyst

📍 Accenture Solutions | Jan 2016 - Sep 2018 | Bangalore

• Automated data extraction with Python, cutting acquisition time by 35%
• Resolved 50+ critical script errors, ensuring system stability

🏗️ Signature Projects

🔗 Real-Time Payment Analytics

Tech: Kafka • PySpark • Redshift • Airflow

• Processed 2M+ transactions/day with <100ms latency
• Reduced fraud detection time from hours → seconds

**🔗 Cloud Data Migration **

Tech: Python • PySpark • SQL • Airflow • AWS Glue • Snowflake

• Cut ETL costs by 40% via auto-scaling and partitioning
• Documented as internal gold standard

📚 Blog Posts & Writing

• Handling Large Data Volumes (100GB — 1TB) in PySpark: Best Practices & Optimizations
  (Practical handling of big data and optimization strategies for data warehouses)
• Data Engineering Best Practices for Production Data Pipelines
  (Best Practices of Data Pipelines)

📚 Knowledge Leadership

• 🏆 Certifications:
  • Microsoft Certified Azure Data Engineer Associate (2025)
  • AWS Certified Data Analytics Specialty (2025)
• 🎓 Education: B.Tech in CSE @ NIT Nagaland (7.74 CGPA)

📄 Resume

📄 Download Resume | 👀 View Online

🌟 Beyond Code

• 🧠 Mentor for early-career data professionals
• 📚 Contributor to open-source data tools

📫 Let’s Build Something Great

Open to:

• Architectural consultations
• High-impact data engineering projects
• Speaking/mentorship opportunities

“Data systems should scale like bamboo—strong, flexible, and resilient.” 🎍