Data engineering has experienced some meteoric growth over the last few years. With this growth, has come the proliferation of pipelines. The proliferation of pipelines has caused the proliferation of bad pipelines since data engineering is difficult to get right on the first attempt.
As a data engineer, you should be able to identify problem pipelines, …
