Senior Infrastructure Engineer

About the role

DataCamp's infrastructure team, which is part of the Platform Engineering department, is a T-shaped cross functional team that looks after CI/CD pipelines, cloud infrastructure (deployed on AWS), logging, monitoring and security. The infrastructure team also looks after the data platform (deployed on GCP) as we have data engineers embedded in our cross functional infrastructure team. The team helps advise our production engineering teams on infrastructure best practices on all DataCamp projects and looks after the whole DataCamp Platform to ensure commercial availability for our customers.

To facilitate this we have a highly automated CI/CD pipeline based on CircleCI and Spotify Backstage (internal engineering portal) which allows developers to ship what they build, increasing deployment speed and ownership and visibility. The infrastructure team aims to enhance developer productivity, scalability, availability and security by providing feedback cycles for teams so they follow a model of continuous improvement.

It will be your role as a part of the Infrastructure team to enable the development teams to deploy their applications as seamlessly as possible and also advise them on either new content for DataCamp courses or any new projects that require infrastructure expertise. You will be managing company wide shared resources which support our microservice architecture, and building upon internal services. The team has a strong bias towards providing self-serve and automation for deployment/infrastructure provisioning as well as cost control and ensuring security standards. The infrastructure team aims to support other teams using these services rather than being a central bottleneck in the company. You will play a key part in planning future improvements and owning your day to day work.

All DataCamp Platform workloads are deployed on EKS (Kubernetes) and our Istio service mesh by the self-service deployment pipelines. All infrastructure is provisioned using Terraform. The infrastructure team also manages the Kong API Gateway allowing external ingress traffic into the DataCamp Platform. The DataCamp Data Platform is deployed on Big Query and airflow manages our data pipeline jobs.

As well as providing means for other development teams to deploy their applications as seamlessly as possible, the infrastructure team takes ownership of the our learn multiplexer product that schedules course sessions for learners on the DataCamp platform.

The ideal candidate

• Has 2+ years of administering/maintaining infrastructure related tools (AWS, Docker, K8s)
• Has 2+ years experience advising on/implementing deployment pipelines (CI/CD)
• Has 2+ years of web development experience (javascript, go, python, node, ruby)

Has 2+ years of security tooling experience (sonarcloud, vulnerability scanning tooling)

• You have experience with Infrastructure-as-code (Terraform, Ansible, etc)
• Has excellent oral and written communication skills
• Is interested in understanding and scaling complex systems
• Is interested in monitoring and self healing systems
• Is highly organized with a flexible, can-do attitude and a willingness/aptitude for learning
• Improves the team with code reviews, technical discussions and documentation
• Is able to work collaboratively in teams and develop meaningful relationships to achieve common goals

It's a plus if

• You have an understanding of data engineering principles
• You have experience with API-gateways or service meshes (Kong, Istio, etc)
• You are passionate about data science and education