Descripción de la oferta
Join to apply for the DataOps Engineer role at Lumenalta We're seeking a Data DevOps Engineer with expertise in data engineering and DevOps to join our team. This role is essential for building scalable, secure, and high-performance data infrastructure on AWS. You will work with modern tools and cloud technologies to ensure seamless data flow from ingestion to insights. What You’ll Do Transform and deliver data, building and maintaining Spark jobs on EKS/EMR Use DBT for data modeling and transformation pipelines (experience is a plus) Manage and optimize data consumption layers with Trino Implement data quality checks and optimize pipeline performance DevOps & DataOps Responsibilities Manage infrastructure as code and deploy via CI/CD Set up monitoring and alerting (e.g., CloudWatch) Secure infrastructure with AWS Secrets Manager and Cognito Manage access/security in Snowflake Maintain scheduling/orchestration with Airflow Qualifications Experience with AWS services (EKS, EMR, CloudWatch, Secrets Manager, Cognito) Proficiency in Apache Spark and distributed data processing Experience with Trino and building efficient data layers Familiarity with DBT or willingness to learn Hands-on experience with infrastructure-as-code tools (Terraform, CloudFormation) Understanding of CI/CD pipelines, monitoring, and alerting Experience managing secure, compliant data systems Proficiency with Airflow or similar tools Strong ownership and operational skills across the stack Bonus Points Experience with Snowflake security/access controls DBT experience Experience in high-scale, data-intensive environments Why Join Us? Work with a modern data stack and a team that values ownership and cross-skilling Remote-first culture with flexible working Opportunity to build and scale critical infrastructure What’s it like to work at Lumenalta? Seniority level Mid-Senior level Employment type Full-time Job function Engineering and Information Technology Industries IT Services and IT Consulting #J-18808-Ljbffr