Descripción de la oferta
Experteer Overview As a Cloudera Data Engineer, you will design and operate high-performance data solutions within the Cloudera ecosystem, collaborating with platform architects, software engineers and DevOps to enable cloud-ready data infrastructure for SIX/BME. You drive performance-focused software development using Spark and Java/Scala, and shape data workflows integrated with Kafka streams. This role sits at the intersection of data engineering and platform operations, delivering scalable data capabilities for financial markets.Compensaciones / Beneficios
- Design, plan and manage Spark-based applications on Cloudera clusters with Kafka streams integration
- Develop and maintain high-quality code with performance in mind using Spark/Java/Scala
- Analyze functional requirements and translate them into detailed technical specs
- Collaborate with platform architects, software engineers and DevOps to operate data solutions
- Work with Cloudera tools (Cloudera Manager, Ranger, Knox, Atlas, Hive) and data technologies (Kudu, HDFS, Impala, Spark)
- Ensure robust software delivery and CI/CD practices (Gitlab, Gitlab CI)
- Contribute to open-source inspired data workflows and best practices across the teamResponsabilidades
- Experience in Cloudera ecosystem (Cloudera Manager, Ranger, Knox, Atlas, Hive)
- Spark with streaming applications (Scala/Java)
- Kafka Streams integration
- Kudu and HDFS data design, Impala queries
- XML, JSON, Avro data formats
- Git (GitLab) usageRequisitos principales
- Flexible work models
- Personal development and extensive learning offerings
- Agile working methods
