Senior Software Engineer, Application Observability

Want more jobs like this?

Get jobs in San Mateo, CA delivered to your inbox every week.

Get Jobs

Send me The Muse newsletters for the best in career advice and job search tips.

By signing up, you agree to our Terms of Service & Privacy Policy.

As a Senior Software Engineer, Application Observability, you will collaborate with data scientists, product managers, and leaders across the company to ensure app quality by working across multiple teams to build and scale a robust anomaly detection system for Roblox. Your work will lay the essential foundation for app quality, driving a great user experience and supporting Roblox's business growth.

You Will:

• Tailor and consolidate real-time detection and root-cause analysis solutions as needed, covering every stage - from code merge, build, and deploy to rollout, full release, and ongoing monitoring.
• Collaborate with pods and teams to define and standardize key metrics, their definitions, and the necessary dimensions essential to release and app health observability.
• Operationalize and scale metrics monitoring by enabling quick slicing and dicing of data across different types of releases and roll-outs, as well as root-cause analysis.
• Work with Data Scientists and ML Modelers to fine-tune severity thresholds for production incidents based on business impact insights from experiments and causal learning.
• Collaborate with engineers to detect and investigate abnormal trends, while proactively and continuously identifying new opportunities to improve visibility, alerting, tooling, and processes throughout the entire release and app health observability lifecycle.
• Be a technical leader for the team and mentor junior engineers and help recruit future talent for the team

You Have:

• Expertise in back-end software engineering with 6+ years of experience building scalable, distributed systems.
• Experience with monitoring and observability for large, consumer-facing applications with an ideal focus on client-side monitoring.
• Comfort rolling up your sleeves and diving into client and application code when needed.
• Experience with defining the correct charts, alerts and queries to understand the health of large applications and systems.
• Proficiency in the incident response process
• Excitement to collaborate with multiple teams and build long-term solutions for all of Roblox
• An understanding of statistics, and familiarity with deploying and running ML models at large scale a strong plus