Descripción de la oferta
About the roleIn SOTEC Consulting (Astek Group) we are looking for a Data Engineer to design and build scalable data solutions on AWS. You will work with business and technology teams to create robust pipelines and modern data architectures. ResponsibilitiesLas cualificaciones, habilidades y toda la experiencia relevante necesaria para este puesto se pueden encontrar en la descripción completa a continuación.Design, develop, and maintain data pipelinesImplement architectures such as data lakes and data warehousesWork with AWS (S3, Glue, Athena, EMR, Lambda)Collaborate with analysts, data scientists, and Dev Ops teamsEnsure data quality, security, and governanceResolve issues and optimize processesLead end-to-end data projects RequirementsExperience with Python and SQLKnowledge of Spark/ScalaExperience with AWSExperience with ETL and data modelingAnalytical mindset and problem-solving skillsAttention to detailC1 level of English PlusExperience with modern architectures (lakehouse)Familiarity xcskxlj with CI/CD tools (e.g., Git Hub Actions)Experience with Apache Iceberg or similar table formatsExposure to data quality frameworks (e.g., Great Expectations, Deequ)Knowledge of Bash and HCL would be an added advantageExperience with orchestration tools (Airflow)
