GeekCodersA DataEngineering Portal
For teamsStart practising free
Python

Python for Data Engineering

Parsing, validation and bounded memory — the Python a pipeline needs rather than the Python a coding test asks for.

8 questions across 3 modules, in the order the concepts build. Each one is graded by running it.
  1. 1
    Parsing and validation
    Read input you did not write, and refuse what is wrong.
    PythonPythonFree0/2
  2. 2
    Shaping records
    Flatten, merge and reshape into something loadable.
    PythonPythonLocked
    • Flatten nested JSON into a fact tableMedium
    • Merge overlapping time rangesMedium
  3. 3
    Bounded memory and ordering
    One pass, a fixed footprint, and work that has dependencies.
    PythonPythonLocked
    • Chunked aggregation over a large CSVMedium
    • Sessionize a clickstream in PythonMedium
    • Top K events in a streamHard
    • Pipeline task execution orderHard