Data Engineer

Company Description

At Longtail we are building an intelligent, autonomous decision streaming platform for airlines. We build humanly impossible workflows by overlaying scalable & granular automation with proprietary algorithms and rich contextual data. The decisions are streamed in real-time directly to airline systems. Current applications built on our platform allow airlines to offer every possible travel product through their network, providing travelers with more travel options in thousands of routes around the world. And we are building more!

The Position:

We are looking for a highly skilled Data Engineer to join our innovative team in Palo Alto, California. In this role, you will play a critical part in developing and maintaining our intelligent, autonomous decision-streaming platform designed for airlines. You will work with a range of technologies to build scalable data systems and infrastructure that process large volumes of data in real-time, enabling them to make millions of informed decisions.

In this role, you'll

• Be responsible for designing, constructing, and maintaining robust and scalable data systems/infrastructure for airline commercial problems.
• Collaborate with cross-functional teams to integrate and ensure the quality of data from various sources.
• Develop our team through mentorship and knowledge sharing.
• Work with distributed data stores like SQL and big data systems like hadoop to manage and process large-scale datasets.
• Leverage your experience with data visualization tools such as Looker, Kibana, PowerBI, etc to build dashboards.
• Leverage technologies like Elasticsearch, Apache beam etc.
• Implement caching and data distribution infrastructures to enhance system performance.
• Troubleshoot and diagnose issues in large-scale, complex systems to ensure high availability.
• Influence the team’s roadmap based on feedback from our internal customers.
• Contribute to recruiting new employees.
• Write technical documentation, and contribute to determining internal processes.

Who you are:

• You have a bachelor's degree in Computer Science, Computer Engineering, Information Systems, or a related field.
• You have 5+ years of experience in data engineering roles.
• You thrive in less structured, ambiguous environments.
• You are data-driven and adept at independent decision-making.
• You draw motivation from building systems that help others be more productive.
• You are curious and driven to understand the needs of your customers.
• You are an engaged and thoughtful collaborator, ready to solve challenging problems with your peers and our customers.
• Simplicity and approachability are top-of-mind concerns when designing systems and tooling.
• Quality and reliability are key pillars in your software engineering philosophy.
• You see mentorship and knowledge transfer as essential prerequisites for a healthy team.
• Experience with working with distributed data stores such as SQL and big data technologies.
• Experience with AWS cloud services.
• Strong problem-solving skills, particularly in troubleshooting and diagnosing large-scale systems.

Preferred Qualifications:

• Programming skills in Java, Python, or any other programming language
• Experience with Apache Beam, Hadoop, Spark is a big Plus
• Experience with creating/managing infrastructure of distributed data stores such as SQL, hadoop etc.

Why join us?

• Work on-site in Palo Alto, CA, with a team of industry experts in a collaborative and innovative environment.
• Contribute to cutting-edge fare management solutions in the airline industry.
• Enjoy a supportive management team that values hard work, fosters professional growth, and promotes a healthy work-life balance.
• Be part of a steadily growing company with opportunities for advancement and professional development.

$140,000 - $200,000 a year

Longtail Technologies is proud to be an equal opportunity employer. We do not discriminate in hiring or any employment decision based on race, color, religion, national origin, age, sex (including pregnancy, childbirth, or related medical conditions), marital status, ancestry, physical or mental disability, genetic information, veteran status, gender identity or expression, sexual orientation, or other applicable legally protected characteristic. Longtail Technologies considers qualified applicants with criminal histories, consistent with applicable federal, state and local law. Longtail Technologies is also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation made due to a disability, please let your recruiter know.

Longtail Technologies is committed to providing highly competitive cash compensation, equity, and benefits. The compensation offered for this role will be based on multiple factors such as location, the role’s scope and complexity, and the candidate’s experience and expertise, and may vary from the range provided below. For roles based in Palo Alto, California, the estimated base salary range for this role is $140,000 - $200,000 per year.