Technology Engineer - (Redis & Kafka)
GSSTech GroupIndia
it-jobs
Job Description
We are seeking an experienced Technology Engineer with strong expertise in Redis, Kafka, and cloud-native platform engineering to join our Technology Engineering team. The ideal candidate will be responsible for designing, implementing, administering, and optimizing enterprise Redis and Kafka platforms supporting high-performance, real-time, mission-critical applications. The role requires strong experience in distributed systems, platform engineering, automation, DevOps, cloud technologies, CI/CD, and production support. The successful candidate will work closely with development, infrastructure, security, and operations teams to ensure platform scalability, resilience, performance, and security. Requirements Key Responsibilities - Design, implement, configure, and manage Enterprise Redis and Open Source Redis clusters. - Deploy, administer, and optimize Apache Kafka clusters for high-throughput, real-time streaming environments. - Ensure high availability, scalability, resilience, disaster recovery, and security of Redis and Kafka platforms. - Perform Redis and Kafka performance tuning, capacity planning, health monitoring, and optimization. - Troubleshoot complex production issues across distributed platform environments. - Manage platform upgrades, patching, configuration management, and lifecycle maintenance. - Build and maintain CI/CD pipelines using Git, Jenkins, ArgoCD, and GitOps methodologies. - Automate infrastructure provisioning and deployment using modern cloud automation tools. - Support cloud-native platform deployments across AWS, Azure, OCI, and OpenShift environments. - Collaborate with development teams to support caching, messaging, streaming, and distributed application requirements. - Implement monitoring, alerting, logging, and operational best practices for production environments. - Drive platform governance, engineering standards, security compliance, and operational excellence. - Work closely with Infrastructure, DevOps, Security, Architecture, and Application Engineering teams. - Support Agile delivery methodologies and participate in sprint planning, backlog refinement, and technical discussions. - Research, evaluate, and benchmark new platform technologies and engineering best practices. - Ensure platform compliance with organizational security, regulatory, encryption, anonymization, and data integrity standards. Required Technical SkillsRedis - Strong hands-on experience with Enterprise Redis and Open Source Redis. - Redis Cluster design, deployment, administration, and management. - Redis performance tuning and optimization. - High Availability (HA), replication, clustering, backup, and disaster recovery. - Redis security and production support. Apache Kafka - Kafka installation, setup, configuration, and administration. - High-throughput messaging platforms. - Kafka cluster management. - Kafka monitoring and troubleshooting. - Event-driven architecture implementation. DevOps & Platform Engineering - OpenShift. - Jenkins. - ArgoCD. - Git. - GitOps. - CI/CD pipeline implementation. - Infrastructure automation. - Production platform support. Cloud Technologies Experience working with one or more public cloud platforms: - AWS - Microsoft Azure - Oracle Cloud Infrastructure (OCI) Distributed Systems Strong understanding of: - Distributed systems architecture - Distributed services resiliency - Network fundamentals - Host-level routing - Streaming platforms - Distributed caching - Performance tuning - Large-scale platform operations Streaming Technologies Experience with: - Kafka - Streaming datasets at scale Good to have: - Kafka Streams - Apache Flink - Apache Beam - Apache Spark - Similar streaming technologies Software Engineering - Design patterns - Automated unit testing - Integration testing - Production troubleshooting - Platform monitoring - Cloud-native application architecture Security & Compliance Strong understanding of: - Security engineering practices - Infrastructure security - Encryption - Data anonymization - Data integrity - Regulatory compliance - Secure logging practices - PII handling - Memory data protection - Vulnerability management Functional Skills - Experience working in Agile/Scrum environments. - Strong analytical and problem-solving skills. - Experience designing enterprise platform architectures. - Technology research and benchmarking. - Ability to influence engineering decisions across multiple teams. - Strong ownership mindset with minimal supervision. - Excellent troubleshooting and production support capabilities. Soft Skills - Excellent verbal and written communication skills. - Strong stakeholder management and collaboration skills. - Strategic thinking with an innovation and R&D mindset. - Self-motivated and proactive approach to problem-solving. - Ability to work effectively in cross-functional and geographically distributed teams. - Strong presentation and interpersonal skills. Nice to Have - Apache Flink - Apache Beam - Kafka Streams - Apache Spark - Event-driven microservices - Cloud-native architectures - Infrastructure as Code (IaC) - Kubernetes - Container orchestration - Large-scale financial services or enterprise platform experience Preferred Experience - Enterprise Platform Engineering - Technology Platforms - Data Platforms - Real-Time Streaming Platforms - Cloud Infrastructure - High-Availability Distributed Systems - Banking or Financial Services domain (preferred)
Get AI-Matched to This Job
Upload your resume and our AI will score how well you match this and thousands of similar roles.