Sr Data Engineer with Kafka

CGIIndia
Adzuna INPosted 12h agoOriginal Listing
it-jobs

Job Description

Position Description: Role and Resposibilitues: . Candidate must have an agile mindset; An expert in Scaled Agile delivery model, experienced with agile ceremonies such as daily scrums, spring planning, sprint reviews and sprint demos. . Design and implement low latency, high throughput streaming pipelines using Kafka, Flink, and Spark Streaming. . Build and maintain event driven architectures for real time data ingestion and processing. . Develop stateful and stateless stream processing applications using Flink and Spark Structured Streaming. . Collaborate closely with various application teams to define integration points and API specification. . Report progress, test metrics and results to the project stakeholders. . Perform all activities involved in the software testing lifecycle. . Highly effective written and verbal communication skills Required Qualifications: . Candidate must have an agile mindset; An expert in Scaled Agile delivery model, experienced with agile ceremonies such as daily scrums, spring planning, sprint reviews and sprint demos. . Should have 8+ years of hands on experience in data engineering roles . Strong experience in building streaming pipeline . Hands on expertise with Hadoop ecosystem, Kafka, Flink, Spark Streaming and SQL . Scala and Python . Oracle Database, SQL, PL/SQL. . Familiarity with CI/CD tools (Git, Bitbucket, uDeploy, ServiceNow) . Familiarity with CI/CD tools (Git, Bitbucket, uDeploy, ServiceNow) . Soft Skills & Client Facing Capabilities . Strong verbal and written communication skills . Ability to explain complex technical concepts to non technical stakeholders . Proven experience working in client facing or consulting roles . Strong problem solving and analytical thinking . Ability to manage multiple priorities in a fast paced environment . Collaborative mindset with leadership capabilities . Highly effective written and verbal communication skills . Preferred Qualifications: Experience in building enterprise scale data platforms Exposure to cloud based data ecosystems (AWS, Azure, or GCP) Knowledge of data governance, security, and compliance practices Experience mentoring junior team members Skills: - Hadoop Ecosystem (HDFS) - Hadoop Hive - Python - Spark SQL - SQL What you can expect from us: Together, as owners, let’s turn meaningful insights into action. Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because… You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction. Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise. You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons. That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals. Come join our team—one of the largest IT and business consulting services firms in the world.

Get AI-Matched to This Job

Upload your resume and our AI will score how well you match this and thousands of similar roles.