Automatical raw data ingestion into data lake

My role was to align internal specification for data representation with the external one provided by our partners

Data preprocessing

My role was to grasp all features of the current mechanism ('black box'), describe it into the code and verify the final result.

A new data uploading mechanics (Kafka)

My role was to work closely with a IT team in our company both on local and global level and our partner (retailer) to implement a new way for raw data downloading.