Data Engineer (Snowflake, spark, Databricks, Python)

Job Description: - Design, develop, and maintain scalable ETL/ELT pipelines using Python, Spark, Databricks, and Snowflake. - Build and optimize data ingestion frameworks from multiple structured and unstructured data sources. - Develop data transformation logic and business rules using PySpark and SQL. - Design and maintain enterprise data warehouses using Snowflake. - Create efficient data models, schemas, views, stored procedures, and tasks in Snowflake. - Optimize query performance, warehouse utilization, and overall Snowflake cost. - Develop scalable data processing solutions using Apache Spark on Databricks. - Collaborate with business analysts, data scientists, and application teams to understand data requirements. - Monitor data quality, data integrity, and pipeline performance. - Troubleshoot production issues and perform root cause analysis. - Implement best practices for data governance, security, and performance optimization. - Participate in code reviews and mentor junior team members. - Work in Agile/Scrum development environments.