eu.tech.jobs
EU-TECH-JOBS // 13,681 OPEN // 1,240 COMPANIES // UPDATED 16/11 14:48 UTC

← all jobs

DevOps Engineer (DWH)

Engineer Software Backend Frontend Full Stack Developer Programmer Coder

Mayflower · United States · Limassol, Cyprus · engineering

We are looking for a hands-on DevOps Engineer with strong Kubernetes and data platform experience to join our DWH infrastructure team.

You will help develop and operate our data platform. It runs on Kubernetes and is built on Airflow, Spark, Trino and Iceberg. We are primarily looking for someone with a Kubernetes/Linux/automation background who also has practical experience with data tooling.

Our platform serves hundreds of thousands of requests per second, and the data platform behind it handles the analytics and reporting for the whole business. We are therefore looking for someone who is already comfortable working with high-load, business-critical production systems, rather than someone whose experience has been limited to small-scale or early-stage environments.

CORE STACK

  • Kubernetes / OKD (OKD is the upstream of OpenShift);
  • Helm / Helmfile;
  • GitLab CI/CD;
  • Argo CD;
  • Apache Airflow;
  • Apache Spark (Spark Operator, Spark Connect, Spark History Server);
  • Trino;
  • Apache Iceberg (Iceberg Catalog);
  • Data governance / data catalog tooling;
  • VictoriaMetrics / VictoriaLogs / Grafana;
  • Tableau;
  • Linux.

Our dedicated platform teams operate the underlying Kubernetes platform, while your team owns and operates the data workloads running on top of it. You will not be responsible for maintaining the cluster control plane, but you should be comfortable deploying, operating, and troubleshooting stateful and compute-heavy workloads in Kubernetes.

Job Responsibilities

Typical tasks in this role include:

  • Deploy, operate, and evolve Airflow on Kubernetes and its integration with Spark, including DAG delivery, executors, connections, and secrets;
  • Operate and tune Spark on Kubernetes: Spark Operator, Spark Connect, and Spark History Server, including resource management, scheduling, and troubleshooting failed or slow jobs;
  • Administer Trino, including catalogs, access control, resource groups, and query performance tuning;
  • Maintain and extend the Iceberg Catalog and the lakehouse storage layer behind it;
  • Develop and support the data governance catalog (metadata, lineage, ownership) and its integration with the rest of the platform;
  • Own observability for the data platform: deploy and maintain VictoriaMetrics and VictoriaLogs, configure metric and log collection, maintain Grafana dashboards, and set up and tune alerts;
  • Develop and maintain Helm chart templates, GitLab CI/CD pipelines, and Argo CD applications for GitOps delivery of platform components and data workloads;
  • Work closely with Data Engineering and Analytics teams. Support production and the environments used for day-to-day development, and help with deployments, environment configuration, infrastructure issues, and release blockers;
  • Troubleshoot issues across Kubernetes, networking, storage, CI/CD, and data tooling, including problems that span multiple systems;
  • Automate repetitive operational tasks and take part in platform upgrades, migrations, and improvements;
  • Review infrastructure code and work with DevOps, Data, and Platform teams on changes that cross team boundaries.

Last seen — · request removal.