Published onJuly 12, 2024Data Engineering Zoomcamp | Week 2.4 Configuring GCP for Mage |MageGCPDockerset up Google Cloud components and configure Mage to read and write data using Google Cloud Storage and BigQuery.
Published onJuly 11, 2024Data Engineering Zoomcamp | Week 2.3. ETL API to Postgres |GuideMagePosgresPythonDockerPandasloading data from an API in a form of a compressed CSV file and loading it to a local Postgres database.
Published onJuly 6, 2024Data Engineering Zoomcamp | Week 2.2. Configuring Postgres in Mage |GuideMagePosgresPythonSQLDockerConfiguring postgres in prepartion for I/O in Mage pipelines
Published onJuly 5, 2024Data Engineering Zoomcamp | Week 2.1. Mage Intro and Setup |GuideMageBigQueryGCPPythonSQLDockerHigh-level overview of Mage. How to configure Mage ready to start building pipelines.