Project Dremio

Description

  • Dremio

  • Dev Python / Dremio

  • DPD / Geopost

  • 2021.11 - present

Introduction

Deploy dremio as datalake query engine inside of group, automate query processes based on daily activities from Business Units. Data ETL with parquet format data in S3 bucket sent by Kafka, develop new features with Python/Dremio/K8s/Helm Chart to satisfy requirements, Regularly update release version between preprod and prod environment in Gitlab.

Technology