⚙️ Aspiring Data Engineer
🏃🏼♂️ I run to keep up with my daughter
📓 https://smallvictories.substack.com/
TIL that BQuery uses a columnar storage format, meaning columns are stored separately. Important to know since BQ pricing is based on data processed by queries. Make sure to only bring in needed columns and LIMIT for sampling.
TIL that BQuery uses a columnar storage format, meaning columns are stored separately. Important to know since BQ pricing is based on data processed by queries. Make sure to only bring in needed columns and LIMIT for sampling.
TIL to orchestrate the same flow as 2025-02-01 except store in GCS and load to BigQuery. Going through the exercises gave me a high-level understanding of Kestra. Practice through projects will help me understand the details by creating flows from scratch. #dezoomcamp
TIL to orchestrate the same flow as 2025-02-01 except store in GCS and load to BigQuery. Going through the exercises gave me a high-level understanding of Kestra. Practice through projects will help me understand the details by creating flows from scratch. #dezoomcamp
TIL to set up a Kestra to orchestrate extract & load of csvs into a separate pg container. Learned scheduling and backfilling data. Sensing that DE is configuring diff technologies together. Helps to have a higher level of understanding before diving into configuring. #dezoomcamp
TIL to set up a Kestra to orchestrate extract & load of csvs into a separate pg container. Learned scheduling and backfilling data. Sensing that DE is configuring diff technologies together. Helps to have a higher level of understanding before diving into configuring. #dezoomcamp
This guy is awesome - www.youtube.com/watch?v=ZDV4...
Terminal emulator - ghostty.org/docs
Ghostty config/zsh plugins - www.bitdoze.com/ghostty-term...
Prompt = starship.rs/guide/
This guy is awesome - www.youtube.com/watch?v=ZDV4...
Terminal emulator - ghostty.org/docs
Ghostty config/zsh plugins - www.bitdoze.com/ghostty-term...
Prompt = starship.rs/guide/