The Senior Data Engineer role is responsible for overseeing the data engineering activities, including but not limited to building the business’ data collection systems and processing pipelines, and building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data Science and Analytics departments.
The Senior Data Engineer is involved in various phases of data science initiatives, starting from data acquisition, data collection, building and configuring the data connectors to funnel data from various heterogenous sub-systems to the corporate data warehouse, data cleansing and merging, creating and maintaining the dimensional models on the data warehouse, creating and maintaining necessary database constructs (such as views, functions, stored procedures), and providing the necessary pipelines to feed the company's visualization tools.
The Senior Data Engineer works closely with the data science leadership as well as other data and analytics teams in leveraging data with reporting and scientific tools, for instance, Tableau, Python, SnowFlake, among other tools and technologies. The Senior Data Engineer strives to continuously develop new and improved data engineering capabilities.
In this role you will:
- Maintain and build on top of our data warehouse and analytics environment, the home for almost all the data.
- Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse, and moving data out to applications and affiliates.
- Build reports and data visualizations, using data from the data warehouse and other sources.
- Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
- Perform one-off data manipulation/munging and analysis on a wide variety of data.
- Implement and monitor best in class security measures in our data warehouse and analytics environment, with an eye towards the evolving threat landscape.
- Help troubleshoot other data engineers’ SQL and Python code among other data manipulation languages and tools.
- Other duties as assigned.
Requirements
- BS in related field or equivalent work experience (MS is preferred for this role)
- Strong command of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database.
- Proficiency with Python or R, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes with these tools
- General data manipulation skills: read in data, process and clean it, transform and recode it, merge different data sets together, reformat data between wide and long, etc
- Demonstrated ability to learn new techniques and troubleshoot code without support, ex. find answers to common programming challenges on Google. In other words, be able to learn on the job
- Demonstrated ability to write clear code that is well-documented and stored in a version control system (we use Git)
- Demonstrated ability to work independently and be a self-starter
- Excellent listening, interpersonal, communication and problem solving skills
- Demonstrated ability to work effectively in teams, in both a lead and support role
- Use APIs to push and pull data from various data systems and platforms
- Experience working with cloud infrastructure services like Amazon Web Services and Google Cloud is preferred but not required
- Effective time management skills, including demonstrated ability to manage and prioritize multiple tasks and projects
- Experience with SnowFlake is required
- Experience with Amazon Airflow is required
- Strong familiarity with Dimensional Modeling
- MDM Processing of Data
- Identity Resolution (Golden Record Generation and Maintenance)
- ETL using DBT
- File Processing using Python
- Experience with advanced data visualization and mapping are required
Entertainment Benefits Group
EBG is an e-commerce solutions provider specializing in travel and entertainment, and also offering retail products and services, voluntary benefits and insurance
Other jobs at Entertainment Benefits Group
Why OmniJobs?
- Rare & hidden jobs
- New jobs every day
- No expired job posts
- All jobs in English
Receive emails about similar jobs
Get alerts to your inbox about new open jobs that are similar to this one.
No spam. No ads. Unsubscribe anytime.
Similar jobs