DE&A - Core - Data Engineering - Data Engineering (Other)

Description Senior Data Engineer – Executive Job Description Role Summary We are looking for a Senior Data Engineer to drive the development of a scalable, enterprise-wide data platform supporting both batch and real-time data processing . The role focuses on building a modern data ecosystem using Snowflake, DBT, AWS Glue, and Amazon Kinesis , enabling high-quality, governed, and performance-optimized data for enterprise consumption. Key Responsibilities - Architect and implement a modern data platform leveraging medallion architecture (Raw, Silver, Gold layers) on Snowflake and DBT - Develop and manage batch ingestion pipelines using AWS Glue and real-time streaming pipelines using Amazon Kinesis - Design scalable data models and transformation logic using DBT to support enterprise analytics and reporting needs - Lead data pipeline optimization initiatives focusing on performance, scalability, and cost efficiency - Ensure data quality, consistency, and governance through validation frameworks and monitoring mechanisms - Support report rationalization initiatives by streamlining data layers and reducing redundancy - Collaborate with cross-functional teams to translate business requirements into robust data engineering solutions Core Skills & Expertise - Strong hands-on experience with: - Snowflake (data warehousing, performance tuning) - DBT (data transformation, modelling, testing) - AWS Glue (batch ETL pipelines) - Amazon Kinesis (real-time data streaming) - Advanced proficiency in SQL and data modelling (dimensional and normalized) - Experience implementing Raw/Silver/Gold data architectures - Strong programming skills in Python/Scala - Expertise in pipeline performance tuning and cost optimization - Insurance domain background preferred Experience - 6–10+ years in Data Engineering / Data Platform Development - Proven experience building large-scale, cloud-based data platforms Success Measures - High-performing, scalable, and reliable data pipelines - Reduced data latency across batch and real-time workloads - Improved data quality and governance standards - Measurable cost and performance optimization in data platform operations Why This Role - Opportunity to build a next-generation enterprise data platform - Work on hybrid real-time and batch architectures at scale - Drive data modernization and optimization initiatives Responsibilities Data Engineer Qualifications Data Engineering experience