Software Engineer (Big Data)

Quantcast is a leading company in advertising technology that revolutionizes how it works through AI-powered solutions. They are seeking a Software Engineer to join their Big Data Services team, focusing on building and optimizing large-scale data processing systems to support data science and engineering teams.

Responsibilities

• Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks
• Debug and resolve issues in distributed environments, including data inconsistencies and job failures
• Maintain and enhance the services that support the distributed storage and compute platform
• Assist in deploying and maintaining production systems, including CI/CD workflows
• Work to make our platform more elastic and fault-tolerant
• Provide technical input into roadmaps for the team
• Write clean, maintainable, and well-tested code

Skills

• BS in computer science or equivalent experience
• 1-3 years of professional software engineering experience (internships included)
• You must be work-authorized in the United States without the need for employer sponsorship
• This is a hybrid role based in our San Francisco. To ensure a manageable commute for in-office days, candidates must reside within a 60-mile radius of San Francisco, CA. No relocation candidates at this time
• Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar
• Familiarity with containerization tools (e.g., Docker and Kubernetes)
• Proficient in Java and/or Python programming languages
• Linux system administration/automation experience
• Strong problem-solving and debugging skills
• Organized, detail-oriented personality
• Experience with workflow orchestration tools (e.g., Airflow) is a plus

Benefits

• Performance bonus
• Equity
• Comprehensive benefits package

Company Overview