Alphasense · Remote

Senior Engineering Manager, AI at Alphasense — Remote

Full-timeRemote$275,000–$375,000/yearPosted 2026-08-05Apply on Greenhouse

Full job description

## About AlphaSense:

About the Team

To support our growth, we are looking for a Senior Engineering Manager to lead the AI Platform team. This group builds and operates our core AI Gateway, serving as the critical high-throughput highway for all Large Language Model (LLM) traffic across the entire AlphaSense ecosystem.

About the Role

This leader will bring deep experience running high-performance teams, a strong background in distributed system architecture, and hands-on familiarity with multi-vendor integrations. Superior communication and strategic collaboration skills are critical for managing expectations and aligning stakeholders across the entire R&D organization.

### Who You Are:

  • Proven Engineering Leadership: Strong track record of managing and growing high-performing teams of senior and staff engineers, with a passion for developing technical leaders and aligning engineering objectives with business strategy.
  • Enterprise Scale Experience: Seasoned background in designing, building, and operating high-throughput, low-latency distributed systems (specifically handling complex routing, caching, queueing, or rate limiting).
  • Technical Thought Leadership: Ability to deeply engage in high-level architectural discussions, provide constructive technical direction, and deliver high-impact feedback during architectural reviews.
  • Strategic Communication: Exceptional communication and partnership skills to align diverse engineering, product, and executive partners across the R&D organization.
  • Modern Tooling & AI-First Mindset: Active embrace of AI tools in developer workflows, with an expectation for the team to leverage AI in their toolchains to maximize engineering velocity.
  • Relevant Tech Stack Experience (Nice to Have):
  • Experience in the applied AI space or working with frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter.
  • Experience with orchestrators and proxies like Temporal, Envoy, or similar enterprise-grade gateway technologies.
  • Experience with Python, Java, and highly distributed caching/queueing systems.

What You’ll Do

  • Strategic Team Leadership: Manage, mentor, and grow a highly talented team of up to 10 senior and staff software engineers (mostly distributed across North America).
  • Foster a high-performance culture of technical excellence, predictable delivery, and career growth.
  • High-Scale Operations & Scaling: Own the strategy and architecture of our enterprise AI Gateway - currently processing up to 1 Trillion LLM tokens per week with a projected 10x growth surge driven by agentic workflows (such as SuperAnalyst) - while ensuring high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms.
  • Multi-Vendor Orchestration: Strategically guide the integration, evaluation, and management of 6+ major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability across different providers.
  • Cross-Functional Alignment: Partner closely with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with core product features and organizational goals.
  • Technical Governance: Define and champion software engineering best practices, architectural standards, and token-based cost-tracking telemetry across the AI Platform organization.

You may also be offered equity, and a generous benefits program.

Compensation Range

$275,000—$375,000 USD

Recruiting Scams and Fraud

  • AlphaSense never asks candidates to pay for job applications, equipment, or training.
  • All official communications will come from an @alpha-sense.com email address.
  • If you’re unsure about a job posting or recruiter, verify it on our Careers page.

Required skills

  • langchain
  • large language model
  • cross-functional
  • delivery
  • java
  • communication
  • python
  • product management
  • team leadership