Contract
We are seeking a highly skilled Kafka Migration Engineer to join the ETO Factory team and support a high-visibility on-prem Apache Kafka to AWS MSK migration project. This role will focus on cluster discovery, topic mapping, capacity planning, platform configuration, migration execution, validation, performance tuning, automation, and legacy cluster decommissioning. The ideal candidate will bring strong hands-on engineering experience with distributed messaging systems, a structured delivery mindset, and the ability to collaborate effectively with application, infrastructure, and platform teams to execute migrations safely and at scale.
Key Responsibilities
▪ Assess on-prem Kafka clusters and perform discovery across topics, partitions, consumer groups, throughput patterns, retention policies, and inter-service dependencies to determine migration readiness.
▪ Analyze workloads based on message volume, business criticality, ordering guarantees, latency requirements, and consumer group complexity to determine appropriate MSK cluster placement and configuration.
▪ Plan and provision required AWS MSK infrastructure capacity including broker sizing, storage, networking, and security configurations to support migration, testing, and production execution.
▪ Execute UAT and production parallel testing using MirrorMaker 2 or similar replication tooling, compare message delivery outcomes, capture evidence, and troubleshoot discrepancies through closure.