Lead Data Engineer – Advanced Data Architecture & Big Data Solutions (Full‑Time, $24/hr) – arenaflex

About arenaflex

arenaflex is a global leader in digital entertainment and technology innovation. With a heritage of creating immersive experiences for millions of users worldwide, arenaflex combines storytelling expertise with cutting‑edge data science to drive personalized content, smarter advertising, and next‑generation product development. Our Information and Investigation group powers the data‑driven engine behind arenaflex’s web‑based platforms, ensuring that every interaction is informed by accurate, timely, and actionable insights. As we expand our footprint in the San Francisco Bay Area, we are looking for visionary data professionals who thrive in fast‑paced, collaborative environments and who want to shape the future of entertainment technology.

Role Overview

We are seeking a Lead Data Engineer to join arenaflex’s Data Products & Analytics team. In this senior role you will design, build, and maintain large‑scale data pipelines and warehouses that support a variety of business units, from content recommendation engines to advertising effectiveness dashboards. You will work closely with product managers, data scientists, and architecture leads to translate complex business requirements into robust, scalable data solutions that enable real‑time analytics and long‑term strategic planning.

Key Responsibilities

• Architect and develop end‑to‑end data pipelines (ETL/ELT) for both cloud‑native and on‑premise big‑data environments.
• Design, implement, and optimize data warehouse schemas, data marts, and lakehouse solutions that meet performance, reliability, and cost‑efficiency targets.
• Collaborate with Data Product Owners, Data Modelers, and Data Architects to define data models, data contracts, and governance standards.
• Build and maintain production‑grade data processing jobs using Hadoop, Spark, Flink, and related technologies.
• Leverage AWS services (S3, EMR, EC2, Redshift, Glue) and Snowflake to create resilient, secure, and highly available data platforms.
• Write clean, modular, and well‑documented code in Python, Scala, and Java; enforce coding standards and conduct peer reviews.
• Monitor pipeline health, troubleshoot failures, and implement automated alerting and remediation mechanisms to meet SLAs.
• Drive continuous improvement initiatives by participating in Agile ceremonies, sprint planning, and retrospectives.
• Maintain comprehensive technical documentation, data lineage, and metadata catalogs to support data quality and compliance.
• Mentor junior engineers, share best practices, and foster a culture of knowledge sharing within the team.

Essential Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field (or equivalent practical experience).
• 5+ years of hands‑on experience designing and operating large‑scale data pipelines in a production environment.
• Strong SQL proficiency with the ability to write complex queries, optimize performance, and create reusable data sets.
• Deep familiarity with Hadoop ecosystem components (HDFS, Hive, Impala, Spark, PySpark) and experience processing terabytes of data daily.
• Proven expertise in at least one major cloud data platform (AWS, Snowflake, Redshift, BigQuery, Azure Synapse).
• Professional‑grade programming skills in Python and either Java or Scala; ability to develop reusable libraries and frameworks.
• Experience building and maintaining data pipelines with orchestration tools such as Airflow, Luigi, or Prefect.
• Solid understanding of data modeling principles, dimensional modeling, and data warehousing best practices.
• Demonstrated ability to work in Agile/Scrum environments, contributing to sprint goals and delivering incremental value.
• Excellent problem‑solving mindset, strong analytical abilities, and effective communication skills.

Preferred Qualifications

• Master’s degree or advanced certifications in data engineering, cloud architecture, or big‑data technologies.
• Hands‑on experience with streaming platforms such as Apache Kafka, Kinesis, or Flink for real‑time data ingestion.
• Knowledge of data governance, security, and compliance frameworks (e.g., GDPR, CCPA).
• Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines for data workloads.
• Previous experience in the entertainment, media, or advertising technology sectors.
• Track record of leading cross‑functional projects and influencing technical direction at an organizational level.

Core Skills & Competencies

• Technical Acumen: Mastery of big‑data processing frameworks, cloud services, and modern programming languages.
• Analytical Thinking: Ability to translate ambiguous business problems into concrete data solutions.
• Collaboration: Strong partnership skills with product, analytics, and engineering teams.
• Leadership: Experience guiding junior engineers and championing best practices.
• Adaptability: Comfort working in a fast‑changing environment where priorities shift quickly.
• Communication: Clear articulation of technical concepts to both technical and non‑technical stakeholders.

Compensation, Benefits & Perks

arenaflex offers a competitive hourly rate of $24 / hour, complemented by a comprehensive benefits package that includes:

• Health, dental, and vision insurance with employer contributions.
• 401(k) retirement plan with matching contributions.
• Generous paid time off, holidays, and flexible work‑from‑home options.
• Professional development stipend for conferences, certifications, and online courses.
• Wellness programs, on‑site gym facilities, and employee assistance resources.
• Employee stock purchase plan and performance‑based bonuses.
• Transportation subsidies and commuter benefits for San Francisco office staff.

Career Growth & Learning Opportunities

At arenaflex, your career trajectory is shaped by your ambition. As a Lead Data Engineer you will:

• Gain exposure to cutting‑edge technologies across the full data stack, from streaming analytics to AI‑enabled recommendation engines.
• Lead strategic initiatives that directly impact product roadmaps and revenue growth.
• Participate in internal hackathons, data‑science bootcamps, and cross‑team innovation labs.
• Access mentorship from senior architects and executives who have built industry‑defining platforms.
• Transition into senior leadership roles such as Data Platform Manager, Director of Analytics, or Chief Data Officer as you demonstrate impact.

Work Environment & Culture at arenaflex

arenaflex fosters an inclusive, collaborative, and curiosity‑driven culture. Our San Francisco office is designed to inspire creativity, featuring open workspaces, quiet zones, and state‑of‑the‑art collaboration rooms. We celebrate diversity, encourage continuous learning, and empower employees to take ownership of their projects. Whether you thrive in a fast‑paced sprint or enjoy deep‑dive technical research, you will find a supportive community that values both results and personal growth.

Application Process

If you are ready to lead the design of data platforms that power the next generation of entertainment experiences, we want to hear from you. Submit your resume and a brief cover letter outlining your most impactful data engineering project.

Apply Job!

Join arenaflex Today

Become part of a visionary team that blends storytelling with data science to create unforgettable experiences for audiences worldwide. Your expertise will shape the future of digital entertainment, and you’ll grow alongside some of the brightest minds in the industry. Apply now and start your journey with arenaflex.