Senior Site Reliability Engineer

At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day.

Being a Great Place to Work is core to how we drive Responsible Growth. This includes our commitment to being a diverse and inclusive workplace, attracting and developing exceptional talent, supporting our teammates’ physical, emotional, and financial wellness, recognizing and rewarding performance, and how we make an impact in the communities we serve.

At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact. Join us!

Job Description:
This job is responsible for partnering with leaders across engineering and technology to define objective reliability goals for services. Key responsibilities include composing observability designs through instrumentation and dashboards, identifying root causes of complex/impactful issues, partnering with cross functional teams to deliver sustainable design patterns, and driving early adoption of non-functional production support requirements. Job expectations include automating services to improve reliability and efficiency and influencing a culture of innovation and continuous improvement.

Responsibilities:

• Designs solutions to visualize key production support metrics enabling Operational Readiness and Site Reliability Engineer teams to identify scenarios requiring intervention
• Develops software solutions and/or improved processes to address work identified as ‘toil’ by collaborating with key partners to identify, track and remediate processes to free time allocated to reliability
• Partners with Development and Infrastructure teams to create error budget policies prioritizing reliability stories that fall below Service Level Objective (SLO) thresholds and suggests code optimizations, additional instrumentation and/or logging structures to gain service reliability visibility
• Identifies and plans for capacity bottlenecks, vulnerabilities and opportunities for reliability improvement, such as low level error rates and 'noise', and reduces manual support effort and/or improves system reliability
• Assesses monitoring for new changes with development partners and works with monitoring tools team to monitor dashboards and enhance application and system monitoring designs
• Engages as a subject matter expert in incident triage efforts, failure scenario modelling and works with the Problem Manager to diagnose root causes for complex/high impact incident/problem management investigations
• Collaborates with Development and Infrastructure teams to understand technical solutions and develop Service Level Indicators and SLOs to measure/improve the reliability of the services they support
• Design and implement highly available and scalable systems, ensuring the reliability and performance of the company's website or application.
• Collaborate with cross-functional teams to define and establish service level objectives (SLOs) and service level agreements (SLAs) for critical systems.
• Monitor systems and applications, proactively identifying and resolving any performance bottlenecks or availability issues.
• Develop and maintain monitoring tools, alerts, and dashboards to provide visibility into system health and performance.
• Conduct post-incident analyses to identify root causes and implement preventive measures to avoid future incidents.
• Automate repetitive tasks and processes to improve efficiency and reduce manual intervention.
• Create and maintain documentation for system architecture, configuration, and troubleshooting procedures.
• Collaborate with development teams to implement and deploy new features and enhancements, ensuring they meet reliability and performance standards.
• Stay up to date with industry best practices, new technologies, and emerging trends in site reliability engineering.

Required Qualifications:

• Minimum 5-10 years experience of Linux/Unix systems and command line tools.
• Proficiency – Moderate experience in scripting languages such as Python, Shell, or Perl.
• Familiarity with cloud platforms like AWS, Azure, or Google Cloud.
• Understanding of networking principles and protocols (TCP/IP, HTTP, DNS, etc.).
• Knowledge with monitoring and logging with Splunk and/or Prometheus, Grafana, or ELK stack
• Strong problem-solving and troubleshooting skills, with the ability to analyze and resolve complex technical issues.
• Excellent communication and collaboration skills to work effectively with cross-functional teams.
• Strong attention to detail and ability to work in a fast-paced, dynamic environment.

Desired Qualifications:

• Experience with APM tools, i.e. DynaTrace
• Knowledge of containerization technologies (Docker, Kubernetes) and orchestration tools.

Skills:

• Architecture
• Collaboration
• Innovative Thinking
• Result Orientation
• Solution Design
• Adaptability
• Analytical Thinking
• Influence
• Stakeholder Management
• Technical Strategy Development
• Automation
• DevOps Practices
• Production Support
• Project Management
• Risk Management