Data Platform Engineer

Mayflower is a technology company that alters the entertainment industry to a new level of perception and engagement.

Job Responsibilities

• Design and build data infrastructure from scratch;
• Deploy and maintain VLogs / VMetrics;
• Set up Iceberg Catalog;
• Implement DataGov catalog;
• Deploy Airflow on k8s and integrate with Spark;
• Configure Spark History Server, Spark Connect, SparkOperator;
• Deploy and administer Trino;
• Migrate Tableau to new infrastructure;
• Develop CI/CD Helm chart templates.

Important/challenging tasks:

• Building a data platform entirely from scratch with no existing solutions — full ownership of architecture decisions;
• Airflow + Spark integration on Kubernetes;
• Tableau migration to the new infrastructure