How to choose between batch, micro-batch, and streaming when building a data pipeline

Speed is all the rage in data engineering nowadays. Stakeholders want their data sooner with higher quality and efficiency!

All this demand for speed can cause data engineers to make stupid decisions by not asking the proper follow up questions to decipher the true requirements from the false ones!