Engineering Manager - Batch Compute Infrastructure

Stripe
Stripe
BengaluruOn-siteCompetitiveAdded 4 days ago
Stripe

Engineering Manager - Batch Compute Infrastructure

Original Advert

Who We Are

About Stripe

Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world's largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important work of your career.

About the Team

The Batch Compute Infrastructure team at Stripe manages the foundational infrastructure, tooling, and distributed systems behind Stripe's massive-scale batch processing environments, currently encompassing over 5,000 computational nodes. Powered primarily by Hadoop, Spark, and Celeborn, these systems are the backbone for several core asynchronous financial, analytical, and regulatory workflows at Stripe, operating at petabyte scale.

What you'll do -
You will support a team of engineers focused on building the tooling, infra and systems for operating Spark, Hadoop and Celeborn at Stripe. In addition to helping define the roadmap for these systems, you will be interacting with many other managers and their teams at Stripe, who rely on the Data processing Infra team to deliver efficient and scalable services to our customers. You will work with both the finance and engineering organization (infrastructure & product) to define, measure and monitor the cost efficiency of these systems. 

Responsibilities

  • Drive Strategic Vision: Define the multi-year roadmap for Stripe's Batch Compute Infrastructure, leading complex architectural shifts and modernization.
  • Lead and Scale: Build, mentor, and aggressively scale a high-performing team of engineers, proactively investing in their career development and fostering a culture of operational excellence.
  • Ensure Operational Rigor: Maintain unwavering reliability for a Tier-0 infrastructure processing tens of thousands of daily workloads, proactively mitigating risks and managing complex on-call telemetry.
  • Cross-Functional Orchestration: Collaborate deeply with data platform teams, finance, and user groups to define compute efficiency metrics, execute massive-scale cost optimization strategies, and guarantee compliance with global financial regulations.
  • Technical Stewardship: Provide technical guidance in architecture reviews, evaluating critical cost, performance, and reliability trade-offs in distributed systems design involving Hadoop, Spark, AWS cloud primitives, and modern metastores.


Who You Are

Minimum requirements

  • 10+ years of professional software development and engineering experience.
  • 3+ years of direct engineering management experience, successfully building and operating high-velocity technical teams.
  • Deep technical background in building, scaling, and maintaining large-scale distributed data systems or Tier-0 infrastructure using open-source tools (e.g., Hadoop, Spark, Celeborn, Airflow, Kafka).
  • Proven track record of driving significant infrastructure efficiency, managing capacity planning, and making data-driven cost-performance trade-offs.
  • Experience working effectively in highly cross-functional, global organizations.

Preferred requirements

  • Experience managing remote or geographically distributed engineering teams.
  • Familiarity with managing a massive fleet of Linux servers, on-premise Hadoop clusters, and modern cloud data architectures (e.g., AWS S3, Graviton).
  • Demonstrated ability to navigate strategic ambiguity and deliver complex, multi-quarter infrastructural projects from inception to completion.
  • Deep empathy for internal data users with a passion for building robust developer tooling and abstractions.

Head of Global Network Partnerships

US-NYC; US-San Francisco; US-Seattle; US-Remote; US-Chicago
1d ago

Engineering Manager - Core Performance

Sydney, Australia
1d ago

Engineering Manager, APAC & EMEA Cards

Singapore
1d ago

Data Science Manager, Growth

Seattle, WA OR New York, NY OR Remote North America
1d ago

Frontend Engineer, Payments & Risk

N/A
1d ago

Sales Manager, Startups

Dublin, Ireland
2d ago

Product Manager, EMEA Payments Lead

Dublin, Ireland
2d ago

Staff Product Manager, Enterprise (Industries)

San Francisco, Seattle, New York, Chicago, Atlanta, Remote
2d ago

UK Public Policy & Government Relations Lead

London
3d ago

Product Manager, SEA

Singapore
3d ago

APAC Executive Marketing

Singapore
3d ago

Backend Engineer, AI Security

N/A
US$157K - US$286K4d ago

Senior Manual QA Engineer

Central Europe
New

Senior NodeJS Backend Developer

València, Spain (Remote)
New
Visa Sponsor

Computer Vision Engineer

Madrid, Spain
New

Junior Android Engineer

Barcelona, Spain (Hybrid)
New

Junior Engineer - Ruby (London)

Barcelona, Spain
New

Junior .NET Engineer

Barcelona, Spain (Hybrid)
New

Senior iOS Engineer

Barcelona, Spain (Hybrid)
New

Android Engineer

Barcelona, Spain (Hybrid)
New

Machine Learning Engineering Manager - Supply

Barcelona, Spain (Hybrid)
New

.NET Engineer

Barcelona, Spain (Hybrid)
New

Engineer - Full Stack

Barcelona, Spain (Hybrid)
New

Business Compliance Manager (Youth)

Madrid, Spain / Mumbai, Maharashtra, India / Bengaluru, Karnataka, India / Kraków, Poland / Dubai - United Arab Emirates / Lisbon, Portugal
3d ago

Creative Marketing Manager

Madrid, Spain / Mumbai, Maharashtra, India / Bengaluru, Karnataka, India / Kraków, Poland / Dubai - United Arab Emirates / Lisbon, Portugal
3w ago

Business Development Manager (New Bets)

Madrid, Spain / Mumbai, Maharashtra, India / Bengaluru, Karnataka, India / Kraków, Poland / Dubai - United Arab Emirates / Lisbon, Portugal
3w ago

Head of Middle Office (Wealth & Trading)

Paris, France / Madrid, Spain / Mumbai, Maharashtra, India / Bengaluru, Karnataka, India / Dubai - United Arab Emirates / London, UK
2mo ago

Business Analyst (Functional Regulatory Reporting)

Madrid, Spain / Mumbai, Maharashtra, India / Bengaluru, Karnataka, India / São Paulo, SP, Brazil / Kraków, Poland / Lisbon, Portugal
3mo ago

Credit Analyst (Business Underwriter)

Madrid, Spain / Mumbai, Maharashtra, India / Bengaluru, Karnataka, India / Kraków, Poland / Lisbon, Portugal
13mo ago

Application managed by Stripe