- Published on
load data to GCP. We will leverage PyArrow to output the NY_TAXI dataset partitioned by date using PyArrow.
Latest
Exploring the world of Data Engineering.
- Published on
set up Google Cloud components and configure Mage to read and write data using Google Cloud Storage and BigQuery.- Published on
loading data from an API in a form of a compressed CSV file and loading it to a local Postgres database.- Published on
Configuring postgres in prepartion for I/O in Mage pipelines- Published on
High-level overview of Mage. How to configure Mage ready to start building pipelines.
Subscribe to the newsletter