VP of Software Engineering

Job Summary

The VP of Software Engineering leads the software roadmap across multiple disciplines including Full Stack, Web, Machine Learning, DevOps, and Site Reliability. This role involves integrating separate teams into a unified system and collaborating closely with Hardware Engineering.

Responsibilities

• Manage the software roadmap aligned with the hardware roadmap across Full Stack, Web, ML, DevOps, and SRE teams.
• Oversee ILM’s serving path including batching, memory management, cache behavior, and scheduling under concurrency.
• Establish engineering standards such as design reviews, benchmarks, release gates, and production readiness, ensuring results are measured on real hardware.
• Optimize model sharing of accelerators across silicon of varying capacities and generations.
• Ensure system reliability including uptime, incident response, postmortem discipline, and fostering a corrective-action culture.
• Build and grow a multidisciplinary engineering organization, hire leaders, and set performance standards.
• Collaborate with Hardware Engineering on telemetry interfaces and co-design decisions requiring synchronized roadmaps.
• Maintain hands-on involvement in code review, benchmarking, and design decisions to ensure credibility.

Requirements

• At least ten years in software engineering with four years leading engineering teams and managing managers.
• Expertise in at least two areas: ML inference or training infrastructure, distributed systems at scale, cloud or platform infrastructure, or high-performance computing.
• Experience delivering software from architecture through production at scale with operational responsibility.
• Proficiency in Python and a systems language such as C++ or Rust, with personal experience optimizing inference or training throughput.
• Knowledge of accelerator memory hierarchies, kernel launch behavior, and identifying real bottlenecks.
• Comfort working on bare metal hardware rather than managed services.
• Ownership of production reliability including on-call, SLOs, incident command, and effective postmortem processes.
• Ability to act as a player-coach in design reviews, incident management, and customer interactions.
• Based in Riyadh or willing to relocate.

Nice to haves

• Experience with CUDA, ROCm, Triton, or similar kernel-level work.
• Contributions to open-source serving stacks like vLLM, TensorRT-LLM, or SGLang.
• Experience with distributed serving and multi-accelerator sharding at production scale.
• Published benchmark or systems research.
• Experience in companies shipping co-designed hardware and software products.
• Founding engineer or leadership experience at a deep-tech company at commercial scale.
• Arabic language proficiency.

What the company offers

• Competitive early-stage compensation.
• Meaningful ownership and impact at an early stage.
• Opportunity to work at one of the first deep tech companies in the region building foundational technology in-house.
• Close collaboration with a small, senior team.
• Challenging problems combining hardware, systems, and AI at scale.

We refresh listings regularly, but some roles close early on the source platform.