In contrast to mixing ETL within a single program, Airflow and shell scripts using GNU Parallel can handle retries, concurrency, logging, etc Am I reading your message wrong? It appears to say that a single program cannot handle retries, concurrency, logging, etc.