Data Engineer

  • Develop data warehouse and feature mart model

  • Develop data processing pipelines to ingest and transform raw data into datasets

  • Technical Requirements:

    o Proficiency in at least one programming language - Java, Scala, Python

    o Proficiency with big data ecosystem - Spark, Hive, HBase, YARN

    o Experience with stream processing - Kafka, Spark Streaming

    o Experience with cloud computing and containerization - AWS, GCP, Kubenetes

    o Experience with microservice development

    o Experience with continuous integration and deployment workflow - Jenkins, Git