TSS - Senior Splunk Engineer

Job Description

GDIT has an opportunity for a Senior Splunk Engineer working with a large line of business within GDIT that is currently supporting multiple contracts for the Defense Information Service Agency in the DC Metro area. We are seeking energetic, talented individuals that have a desire to help transform customer requirements supporting the DISA Enterprise Identity, Credential and Access Management (ICAM) contract.

The Senior Splunk Engineer is responsible for coordinating with the system architecture, engineering and administration teams to improve system monitoring and security automation features.  Supports capacity and performance analysis, and provides system configuration change and upgrade recommendations.  Improves system administrator efficiency and accuracy via the use of automated tools and scripts, supports evolution of system administrator procedures, and provides content in support of system administrator training. Ensures system security and executes practices and procedures. Supports troubleshooting of system related problems. Performs database design and software development as required.

Able to perform direct and advisory roles in oversight, planning and implementation of projects and initiatives.  Advise management and team members of risks associated with technologies and implementation approaches and identify methods of risk mitigation. Support problem resolution and identify process improvements.  Interface as needed at multiple levels of management, providing information and thought leadership in technical areas.

Specific examples of responsibilities include but are not limited to:

• Ability to navigate Linux CLI, troubleshoot, create services, update OS, etc.
• Implement automation orchestration to replace repetitive tasks which are being conducted manually
• Performing system development, design, modeling, analysis, integration, and sustainment of CyberNetOps systems. Recommend new tools as the core systems evolve.
• Developing advanced dashboards, data models, reports and performance optimization.
• Designing and customizing complex search queries and promoting advanced searching, forensics, and analytics.
• Developing and documenting configuration standards, policies, and procedures for operating, managing and ensuring the security of system infrastructure.
• Participating in incident, problem, and change management processes.
• Planning and directing upgrades and system enhancements.
• Developing and implementing testing strategies and documenting results.
• Developing documentation on new or existing systems.
• Providing system/equipment/specialized training and technical guidance.
• Serving as liaison with clients, participating in meetings to ensure client needs are met.
• Communicating with customers and teammates clearly and concisely.
• Support automation management and security of container-based workloads via scripting and tools
• Provide recommendations for improvement across the enterprise as well as migration strategies from legacy to containerized and automated platforms

Required Skills:

• 8+ years of related systems engineering experience - primarily in a government environment, dealing with business critical, high availability systems.
• 5+ years Red Hat Linux experience in an enterprise environment
• 2+ years of Splunk experience
• Experience configuring and utilizing monitoring/logging and security analysis solutions
• Understanding of systems monitoring, alerting and analytics (using technologies such as Prometheus, Grafana, AppDynamics, ELK, Nagios, Splunk, etc.)
• Experience with Docker and management of containers
• Strength in multitasking and prioritization in order to meet periodically changing deadlines
• Self-starting and able to drive projects to completion in a fast moving environment
• Solid communications skills, both written and verbal.  Able to create, discuss and explain technical documentation.
• Development of documentation for engineering from requirements and architectural designs, and diagrams.
• Experience of designing and implementing highly available solutions.
• Ensure data integrity by evaluating, proposing, implementing and managing software and hardware solutions.

• Recommend and implement system enhancements that improved the performance, security, and reliability of the system

Desired Skills:

• Identity Management and Authentication/Authorization experience (e.g. Active Directory, SAML, LDAP, MFA, OAuth 2.0, OIDC, etc )
• Linux, Splunk, or other relevant certifications to the position
• Experience developing coding/scripting to build required automation and tools (using Ansible, Ruby, Python, Bash, Powershell, Java, etc.)
• Experience supporting production systems using Site Reliability Engineering (SRE) practices
• Experience with DevSecOps concepts, tools and automation skills
• Familiarity with industry standard host based security systems (HBSS) and Assured Compliance Assessment Solutions (ACAS)
• Experience working with Gitlab for SDLC (CI/CD) functionality
• Knowledge of various network vulnerability scanning platforms (Nessus, etc…)
• Knowledge of Routers, Switches, Firewalls, and authorization boundaries
• Knowledge of current IT security best practices
• Knowledge of system administration, networking, and operating system hardening techniques
• Mixed operating systems experience: (Linux, Windows)
• Security+ CE  or other 8570 IAT level II certification
• Kubernetes or similar technology familiarity
• Experience troubleshooting issues related to storage

The likely salary range for this position is $112,000 - $168,000. This is not, however, a guarantee of compensation or salary; rather, salary will be set based on experience, geographic location and possibly contractual requirements and could fall outside of this range.

View information about benefits and our total rewards program.

We are GDIT. The people supporting some of the most complex government, defense, and intelligence projects across the country. We deliver. Bringing the expertise needed to understand and advance critical missions. We transform. Shifting the ways clients invest in, integrate, and innovate technology solutions. We ensure today is safe and tomorrow is smarter. We are there. On the ground, beside our clients, in the lab, and everywhere in between. Offering the technology transformations, strategy, and mission services needed to get the job done.

GDIT is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status, or any other protected class.