Principal Systems Engineer

DomainTools is looking for a Principal Systems Engineer to lead our Platform Infrastructure team within Technical Operations. Come build the bare-metal infrastructure enabling delivery of our security products to almost half of the Fortune 100.

Platform Infrastructure is a small group of engineers focused on delivering the server- and low-level service building blocks that power the engineering platform for our on-premise hybrid cloud environment. This includes physical hosts, bootstrap services, Kubernetes cluster deployment and operations, and datacenter management. Our goal is to provide our internal customers with self-service access to datacenter infrastructure in simple, fully-automated ways that scales elegantly to power existing and future services as they move into our development platform. We partner closely with the Platform Engineering and Technical Operations teams.

Location: Remote within US

Compensation: $145,000-$170,000 Base +15% Annual Performance Bonus

Requirements

Job Responsibilities:

• Build and operate the tools and processes that enable fully-automated bare-metal Linux-based host provisioning across our various colocation environments

• Design, build, and help operate highly-available Kubernetes-based infrastructure that powers our hybrid cloud platform, in close partnership with the Platform team

• Collaborate with internal customers to build self-service interfaces on our Platform that simplify and accelerate service delivery on bare metal hosts

• Instrument and optimize system and cluster performance including power consumption, network performance, and physical rack design

• Forecast and plan capacity increases to ensure resource availability for engineering teams while meeting budget targets

• Provide thought leadership on DevOps and Platform Engineering-centric system and process design, giving constructive input to engineers and leaders on proposals and best practices

• Lead by showing: mentor and help develop engineers on sister teams in a highly demonstrative and collaborative way

• Participate in an on-call rotation with fellow team members

Key Qualifications:

• 10+ years experience in Linux systems engineering roles supporting bare metal servers, virtualization, and container platforms
• Experience building and managing infrastructure in both public cloud and physical data center environments using IaC tools
• Experience automating the Linux boot environment (PXE, TFTP, Kickstart)
• Proven ability to automate the right things in the simplest way possible (scripts, config management tools, CI pipelines, etc.)
• Solid understanding of networking fundamentals and storage technologies
• Experience building and managing Kubernetes clusters
• Ability to communicate well and publish docs that are easily understood by stakeholders
• Experience supporting customer-facing SaaS products
• Willing to dive in and own problems that are new, ambiguous, or complex
• Proven ability to prioritize where improvements are most needed; sees the forest for the trees
• High team standards around communication, giving and receiving feedback, continuous improvement, and operational excellence

Relevant Technologies:

• Compute: CentOS/Rocky Linux, Kubernetes, Rancher RKE2
• Storage: Longhorn, MinIO, Linux LVM and filesystems
• Languages: Bash, Python
• Automation Tools: Ansible, Terraform, GitLab, Hashicorp Vault/Consul
• Cloud: AWS (EC2, S3, Glacier)
• Monitoring/metrics: Prometheus, Icinga/Nagios, Graphite, Grafana, CollectD
• Logging: ELK/OpenSearch, Syslog, Journald
• Load Balancing: Nginx, HAProxy, Keepalived

Benefits

DomainTools is the global leader for internet intelligence and the first place security practitioners go when they need to know. The world's most advanced security teams use our solutions to identify external risks, investigate threats, and proactively protect their organizations in a constantly evolving threat landscape. DomainTools constantly monitors the Internet and brings together the most comprehensive and trusted domain, website and DNS data to provide immediate context and machine-learning driven risk analytics delivered in near real-time.

DomainTools offers a comprehensive benefits package to our employees that includes fully paid medical, dental and vision insurance premiums, a 401k retirement plan with company matching, basic life insurance, flexible PTO and additional well-being benefits.

DomainTools embraces diversity, equity, and inclusion to its fullest as an equal opportunity employer. We build our teams so creativity and innovation can flourish. We believe inclusivity and equity fosters innovation and growth; and we harness this mindset to drive a culture that serves our employees and our customers. We encourage people of all backgrounds, ages, perspectives, and skill sets to apply; and do not discriminate based on age, religion, color, national origin, gender, sexual orientation, gender identity, marital status, veteran status, disability, or any other characteristic protected by law.