Descripción de la oferta
About the roleIn SOTEC Consulting (Astek Group) we are looking for a Data Engineer to design and build scalable data solutions on AWS. You will work with business and technology teams to create robust pipelines and modern data architectures.ResponsibilitiesDesign, develop, and maintain data pipelinesImplement architectures such as data lakes and data warehousesWork with AWS (S3, Glue, Athena, EMR, Lambda)Collaborate with analysts, data scientists, and DevOps teamsEnsure data quality, security, and governanceResolve issues and optimize processesLead end-to-end data projectsRequirementsExperience with Python and SQLKnowledge of Spark/ScalaExperience with AWSExperience with ETL and data modelingAnalytical mindset and problem-solving skillsAttention to detailC1 level of EnglishPlusExperience with modern architectures (lakehouse)Familiarity with CI/CD tools (e.g., GitHub Actions)Experience with Apache Iceberg or similar table formatsExposure to data quality frameworks (e.g., Great Expectations, Deequ)Knowledge of Bash and HCL would be an added advantageExperience with orchestration tools (Airflow)
