In today's data-driven landscape, companies require robust and reliable data pipelines to facilitate modern analytics initiatives. A well-designed pipeline promotes the timely movement of data from various sources to processing systems, allowing engineers to gain valuable insights. To develop such pipelines, it is crucial to factor in factors such