Published onJuly 13, 2024Data Engineering Zoomcamp | Week 2.5 ETL, API to GCP using Parquet with Partitioning through PyArrow. Pipeline in Mage |MageGCPPyArrowParquetPartitioningload data to GCP. We will leverage PyArrow to output the NY_TAXI dataset partitioned by date using PyArrow.