01/09/2021

Life of a Data Engineer

  • Skills
  • Routine
  • Tasks
  • Challenges

Skills

  • Programming languages
  • Databases and their optimization in every aspect
  • Basic statistics
  • Good business understanding
  • Great communication

Routine(as a remote worker)

meetings

  • daily
  • planning
    • retrospective
    • ranking tasks

pair programming

gaming friday

Tasks

  • Writing code
    • Python(get data from the web)
    • SQL(manipulate data and draw insights from it)
  • Reviewing code
    • Git/GitHub(code version control)
  • Documenting code and other decisions from business perspective
  • Helping coworkers on their tasks

Challenges

  • Building data pipelines which scale
  • Reducing costs
  • Writing quality code
  • Communicating results