Senior Data Engineer

JOB DESCRIPTION

Role: Lead SDE – Analytics

About Amagi

Amagi is a cloud-native SaaS platform that lets every content owner deliver their content to consumers anytime, anywhere, to any device. Amagi helps bring entertainment to hundreds of millions of consumers leading the transformation in media consumption. We believe in a connected ecosystem bringing content owners, distribution platforms, consumers and advertisers together to create great experiences.

Amagi grew by 136% last year and is on its way to double itself again this year. The market leader in FAST (Free Ad-supported Streaming TV), it delivers more than 500 media brands to 1500+ end points and is growing exponentially.

Amagi Monetise

Amagi Monetise group focuses on building products that help in monetisation for our customers in different streaming segments – FAST (Free Ad-supported Streaming TV), VoD (Video on Demand) and Live Events. This group consists of various products like

Amagi Thunderstorm is our proprietary DAI (dynamic ad insertion) solution that allows our customers to monetize live, linear and VoD (video-on-demand) content at scale. It is a highly scalable, cloud-native, multi-tenant product that serves billions of ad impressions every month and continues to grow exponentially. Thunderstorm is also building market-leading innovations in DAI that uses data at scale, machine intelligence and rapid iteration and experimentation to revolutionize this market.

Amagi Analytics develops the end-to-end Analytics Product which offers critical insights across content, advertising, billing etc. to the customers. It is a highly scalable platform which ingests multiple TBs of data per day and makes them available to the end user in near real time.

Amagi Ads Plus offers a marketplace to help our customers increase monetisation.

Team

The team is responsible to build the new gen Analytics platform from scratch to enrich the Amagi product portfolio to enable customers with the highly informative data analytics of the streaming information of their channel, platform and deliveries across regions and devices. An Insightful dashboard to showcase the trending analytics of various metrics across channel viewership, content analytics and Ads for both linear as well as VOD channels which is made possible through crunching millions of viewership hours from TBs of viewers heartbeat log. Create efficient, cost effective, scalable and manageable data pipelines to build strongly typed data models to quickly serve millions of data points to the viewport.

Role reporting into: Senior Manager, Product Development

Location: Bangalore, India

Key Responsibilities

• Take complete ownership and accountability of feature requirements from conception till delivery and continue to manage, sustain and optimize the system.
• Build, deploy and maintain a highly scalable data pipeline framework which enables our developers to build multiple data pipelines from different kinds of data sources.
• Collaborate with the product, business, design and engineering functions to be on top of your team’s deliverables & milestones.
• Timely delivery of highly reliable and scalable engineering architecture, and high quality, maintainable and operationally excellent code for your team.
• Identify and resolve performance and scalability issues.

You will excel at this role, if you have

• Bachelor’s/master’s degree in Computer Science with 3+ years of overall experience
• Deep understanding of ETL frameworks eg. Spark, MapReduce or equivalent systems.
• Understanding of OLAP systems and data modeling like star and snowflake schema.
• Understanding of at least one of ETL technologies like Dataproc, Databricks, PySpark.
• Datalake sql query engine like Trino, Presto, Hive.
• Building complex pipelines using orchestration frameworks like Apache Airflow, Argo or similar.
• Sound knowledge of Python, Pyspark and frameworks like Django, Flask etc.
• Strong knowledge in the public cloud, GCP is preferred.
• Experience in optimizing spark, sql, datapipeline and troubleshooting.
• Strong debugging skills to find RCA, workaround, resolution, long and short term mitigation.
• Strong experience in Agile development methodologies to plan, break down, estimate feature requirements in EPIC, stories and subtask.
• Good communication skills.
• Experience working with Agile methodologies.