Data Engineering Intern

Investigate and improve data science model output delivery.

Background

Within ING we make use of data science for a variety of use cases (such as improving financial health of our customers by transaction forecasting). The data science models which run in production all generate output this data needs to be delivered to different destination within ING. These destinations vary from data lakes and kafka topics to Cassandra datastores.

In the past a generic Interface format (GI) was developed as a one size fits all solution to standardize the output delivery for our data-scientists. Over time many models have adopted this interface but we are now facing challenges such as files which became too big or the throughput time is too long.

The opportunity

We would like to deep-dive into this topic by dedicating an intern as engineer to investigate our use cases and look for a future proof solution. This includes gathering information, do market research (buy vs built) and design / develop one or more prototypes together with our data-scientists data engineers.

Team overview

You, as an intern will join one of our data-engineering teams which support the ING data-scien...