Principal Engineer - TestRail

About Sembi

Sembi leads the market in test case management with TestRail, Xray, and Testmo, alongside Ranorex for test automation, Hexawise for combinatorial test design, and Kiuwan and PreEmptive for application security. Our products serve 10 million users worldwide and hold over 20 billion test case data points. As agents write more of the world's code, we believe our data and orchestration platform will become the foundation of trust for the AI SDLC.

The team and the role

You'll join the TestRail group, a set of teams that build TestRail Cloud, TestRail Server, and the administration portal and own each through its full lifecycle. We created this role to solve the hardest problems and help the teams solve harder ones. It is an individual-contributor role with no direct reports. You'll work inside the teams, going to where the issues are, and improve the system through hands-on development, coaching, and collaboration with Architecture and Platform Engineering. The goal is a TestRail that is more available, faster, and cheaper to run, and that delivers more value to customers.

What you'll own

• Raise the bar for the teams. Introduce the tools, practices, and training that make high-quality, frequent, safe releases the default for the TestRail teams. Measured by:
  • DORA metrics
  • Adoption of, and contribution to, shared platform tooling
  • TestRail developer experience feedback
  • Time to first and fifth production deploy for engineers
• More frequent deployments. Equip the teams to ship TestRail Cloud to production more often and in smaller batches, from multiple deployments a week toward many a day. You'll coach them through the architecture, tooling, and release practices that make it possible. Measured by the teams' deployment frequency and change-failure rate.
• Faster response times. Make TestRail faster alongside the teams: every SLA-tracked endpoint under one second at p90 on a realistic data set, then lower. You'll trace the bottlenecks with them and fix them together. Measured by the teams' p90 response times on SLA-tracked endpoints.
• Increase customer success. Improve the foundation the teams build on so they can take on the features customers have been asking for, from improved reporting to AI-native capabilities. Measured by contribution to the teams' NPS score.

What we'd like you to bring

• Expert-level depth in at least one language, ideally PHP, and in at least one cloud platform, ideally AWS, and comfort picking up new ones.
• A track record of raising a team's engineering practices, through tooling, standards, and training that stuck after you moved on.
• Experience introducing tools and practices (continuous delivery, observability, infrastructure as code, high-value testing strategy) to teams that previously lacked them.
• A record of re-architecting production systems under load, tracing bottlenecks to the right layer, with before-and-after numbers.
• Initiative to spot what needs fixing and fix it, with little prescription.
• Clear communication, and the ability to translate work into economics for Senior Leadership.
• Advanced AI use, and the drive to lead the team in new ways of working.

What we'll help you learn

• TestRail's PHP codebase and architecture
• Our AWS cloud architecture
• Sembi's shared platform tooling
• The quality and testing industry
• Sembi's operating model
• TestRail Server use cases, pricing, and billing
• Our AI platform and vision

How we work

• We work with urgency, focused on the most important work each quarter.
• We take full responsibility for results, with no excuses and a lot of learning.
• We keep process light and cut whatever doesn't move the work forward.
• You'll be a regular contributor in standups, planning, and code review, working alongside the development teams, the Architecture group, and Platform Engineering.
• You'll tailor process and tooling to local teams, while actively partnering with and contributing to Platform Engineering and IT teams.
• You'll teach as you work, through pairing, code review, and training for the TestRail teams.
• Incident response runs through a rotation with an escalation path, and you'll take part.
• Everyone is expected to lead, whatever their title.