Senior Kafka Developer

ProArch is seeking a skilled Senior Kafka Developer with AWS experience to join our innovative team. In this role, you will be responsible for designing, developing, and managing Kafka-based solutions that improve our data streaming capabilities and support our cloud infrastructure on AWS.

Key Responsibilities:

• Design, develop, and implement Kafka streams and data pipelines to facilitate real-time data processing and analytics.
• Integrate Kafka with various data sources and sinks, ensuring data flow across different applications.
• Work alongside data architects and engineers to optimize data flow and storage patterns in AWS.
• Monitor and troubleshoot Kafka clusters, ensuring high availability and reliability of services.
• Implement security measures and manage data governance to protect sensitive information.
• Collaborate with cross-functional teams to define and refine requirements for data processing functionalities.
• Document data pipeline designs, workflows, and operational processes for reference and knowledge sharing.

Requirements

To be successful in this role, candidates should possess the following qualifications:

• 4+ years of experience in developing applications using Kafka.
• Strong understanding of AWS services such as Kinesis, S3, EC2, Lambda, and CloudFormation.
• Proficient in programming languages like Java, Scala, or Python.
• Experience with data modeling and schema design using Avro or JSON.
• Familiarity with monitoring tools for Kafka, such as Confluent Control Center or Grafana.
• Strong analytical and problem-solving skills.
• Excellent communication skills and ability to work in a team-oriented environment.
• Knowledge of data governance, security, and compliance frameworks is a plus.

Qualification

Bachelor's Degree