Kafka Engineer

il y a 2 semaines


Bertrange, Luxembourg CTG IT Solutions Temps plein 85.000 € - 110.000 € par an

We are looking for a skilled and motivated Kafka Engineer to design, deploy, and manage scalable, real-time data streaming solutions using Confluent Kafka and Confluent Cloud platforms.

The ideal candidate will have hands-on experience in large-scale production environments, strong DevOps expertise, and a solid understanding of automation, CI/CD, cloud deployment, and Linux systems. You will collaborate with cross-functional teams to ensure the reliability, performance, automation, and security of our data pipelines and streaming infrastructure.

Your missions:
  • Design, configure, and deploy Kafka clusters to support high-volume, real-time data streams across multiple environments.
  • Design, implement, and maintain CI/CD pipelines using Azure DevOps (Repos, Git, Pipelines).
  • Develop and maintain automation scripts using Bash (Python is a plus).
  • Manage and configure Ansible for infrastructure automation.
  • Work extensively with Linux commands and system administration tasks.
  • Deploy and manage applications and infrastructure across AWS and Azure cloud platforms.
  • Implement and support Kafka for messaging and streaming solutions, including installation, configuration, and troubleshooting.
  • Design and document architecture diagrams for solutions and deployments.
  • Monitor platform health and troubleshoot issues using tools such as Splunk.
  • Ensure system reliability, scalability, and security across environments.
  • Collaborate with development and operations teams to improve delivery processes and platform standards.
  • Stay up to date with Kafka ecosystem advancements and DevOps tooling best practices.
Your Profile:
  • Proven experience working with Kafka in large-scale, production environments.
  • Strong understanding of Kafka architecture, internals, and ecosystem components.
  • Expertise in Confluent Kafka and Confluent Cloud.
  • Azure DevOps expertise (Repos, Git, Pipelines).
  • Strong Bash scripting skills; Python knowledge is a plus.
  • Proficiency with Ansible and Linux system administration.
  • Hands-on experience with AWS and Azure cloud deployments.
  • Ability to create clear, accurate architecture and deployment diagrams.
  • Knowledge of Infrastructure-as-Code (IaC) tools such as Terraform and Ansible.
  • Familiarity with DevOps tools such as GitHub, Nexus, Jira, Azure DevOps, and Splunk.
  • Exposure to containerization technologies (Docker, Kubernetes) is a plus.
  • Understanding of cloud and DevOps security best practices.
  • Effective communication skills and the ability to work collaboratively in a team environment.
  • Self-motivated, proactive, and comfortable in a fast-paced environment.
  • Fluent in English.
Our Offer:

At CTG, we believe in rewarding our employees and providing an appealing work environment. When you join our team you can expect:

  • Competitive salary package, with or without a company car.
  • Personalized training programs and development plans to nurture your skills.
  • 5 additional vacation days
  • Regular team-building events, learning lunches, and fun activities.
  • Extra-legal benefits (daily allowances, PC plan,...)

Please note that a criminal record check will be required for this position.

Discover the exciting opportunities that await you at CTG, where your IT expertise meets a world of possibilities