As a senior engineer in the SRE Service Operations team, you will be involved in designing and running the infrastructure and services that form the base of Wikimedia Foundation’s projects, including, but not limited to: Kubernetes clusters, application servers, related datastores, and other developer-facing services. You will participate in 24/7 incident response and be on-call rotation. This role requires frequent work with other members of the SRE team to maintain and improve our systems, as well as interacting with people not in SRE, like Security, Release, and Software Engineers, together striving to move our projects and technologies forward.

We use more technologies than we can list here, and are interested in your experience even if it doesn’t exactly match the keywords above / below. If you find what we do interesting and enjoy the idea of working with a globally distributed team that runs a Top-15 website, we may be what you’re looking for!

You are responsible for:

• Design, implementation and maintenance of public facing infrastructure and services

• Use of configuration management and deployment tools

• Architectural design and operation at scale

• Monitoring of systems and services, optimization of performance and resource utilization

• Proactively identify sources of instability in distributed systems and analyze how complex systems fail from a reliability and resilience perspective.

• Common operating system level tasks such as logging and backup / restore

• Cookbook / runbook implementation for common maintenance actions 

• Participate in 24/7 on-call rotation and escalations for resolving production issues

• Lead incident response and post-incident reviews, contributing to failure analysis and implementing preventive measures

• Automation and streamlining of tasks as well as identifying process gaps

• Collaborating with a global and asynchronously communicating team (don’t worry if you have never worked remotely, we’ll help you get used to it)

• Mentoring peers in your areas of technical and operational strength

• Expected to travel domestically or potentially internationally 2-3 times in a year for team gatherings and conferences

Skills and Experience:

• 5+ years of experience in an SRE/Operations/DevOps role

• Experience with operating highly available infrastructure

• Experience with running applications and services at scale

• Experience implementing containerization solutions (Docker, Kubernetes)

• Proficient with shell and a programming language used in an SRE/Operations engineering context (Python, Go, Ruby, etc.)

• Comfortable with Open Source configuration management and orchestration tools (Puppet, Ansible, TerraForm etc.)

• Communicative technical English

Additionally, we’d love it if you have:

• Experience with package management for operating systems (Debian, etc)

• We are avid supporters (and users) of open source software; history of contributing to Open Source projects is valued

• Familiarity with RFC 2549

• Prior participation in the Wikimedia movement