How To Design Pipelines and Sort by Dependencies in Python

Sort a direct acyclic graph (DAG) with parallel steps

Photo by JJ Ying on Unsplash

Recently I had to work on how to build a pipeline from a configuration file.

And the tricky part is always how to simplify how to write the configuration file, especially on how to manage the order of the pipeline steps and make it human-readable. My…