Mer
@mertheman.bsky.social
፨ People Data mythbuster.
⚙️ Aspiring Data Engineer
🏃🏼♂️ I run to keep up with my daughter
📓 https://smallvictories.substack.com/
⚙️ Aspiring Data Engineer
🏃🏼♂️ I run to keep up with my daughter
📓 https://smallvictories.substack.com/
Pinned
Mer
@mertheman.bsky.social
· Jan 3
GitHub - DataTalksClub/data-engineering-zoomcamp: Free Data Engineering course!
Free Data Engineering course! . Contribute to DataTalksClub/data-engineering-zoomcamp development by creating an account on GitHub.
github.com
This will be my thread/journal on the things I learn during the upcoming Data Engineering Zoomcamp.
For those interested in joining, here is the link to the Github repo
github.com/DataTalksClu...
For those interested in joining, here is the link to the Github repo
github.com/DataTalksClu...
Context switching has rendered me useless
June 11, 2025 at 11:43 AM
Context switching has rendered me useless
I started posting on my substack again to get better at writing. I'm aiming to just post about my experiences as a data professional and how my past experiences have helped me.
Here's my most current post if any are interested.
substack.com/home/post/p-...
Here's my most current post if any are interested.
substack.com/home/post/p-...
The Power of Detail in Data
Attention to Detail
substack.com
June 9, 2025 at 1:27 PM
I started posting on my substack again to get better at writing. I'm aiming to just post about my experiences as a data professional and how my past experiences have helped me.
Here's my most current post if any are interested.
substack.com/home/post/p-...
Here's my most current post if any are interested.
substack.com/home/post/p-...
Does anyone here have a data stack using resources in the Azure Marketplace? I'm looking to get a data warehouse going for my small team What do you use for:
- ingestion
- transformation
- storage
- orchestration
#databs
- ingestion
- transformation
- storage
- orchestration
#databs
June 4, 2025 at 10:53 AM
Does anyone here have a data stack using resources in the Azure Marketplace? I'm looking to get a data warehouse going for my small team What do you use for:
- ingestion
- transformation
- storage
- orchestration
#databs
- ingestion
- transformation
- storage
- orchestration
#databs
Data SMEs need to have a seat at the table when discussing KPIs or OKRs. Especially when those metrics determine compensation actions. If you don't, you run the risk creating a metric that can't be measured or over promising on measuring capabilities.
May 11, 2025 at 12:40 AM
Data SMEs need to have a seat at the table when discussing KPIs or OKRs. Especially when those metrics determine compensation actions. If you don't, you run the risk creating a metric that can't be measured or over promising on measuring capabilities.
Me: “Hey, can I set up some time to go over your code that uploads a file to share point?”
Dev: “sure, I’ll need a code to charge my time to”
Does anyone else experience this?
Dev: “sure, I’ll need a code to charge my time to”
Does anyone else experience this?
February 17, 2025 at 10:23 PM
Me: “Hey, can I set up some time to go over your code that uploads a file to share point?”
Dev: “sure, I’ll need a code to charge my time to”
Does anyone else experience this?
Dev: “sure, I’ll need a code to charge my time to”
Does anyone else experience this?
TIL to inspect/clean my data prior to merging in pandas. Output had 0 rows. Def something with the join. Inspected the output of each df prior to the merge and saw the column I was joining on had extra spaces. Trim function worked. db2 to SQLServer data joined. 80 sec vs 2 hours in power BI
February 14, 2025 at 7:27 PM
TIL to inspect/clean my data prior to merging in pandas. Output had 0 rows. Def something with the join. Inspected the output of each df prior to the merge and saw the column I was joining on had extra spaces. Trim function worked. db2 to SQLServer data joined. 80 sec vs 2 hours in power BI
Last week instead of learning about Kestra for orchestration, I used 'productive procrastination' to learn about the terminal, shells, prompts and plugins to achieve a beautfil terminal. Proud to say I achieved both form and function on my little sidequest. Here's what it looks like now.
February 1, 2025 at 3:03 AM
Last week instead of learning about Kestra for orchestration, I used 'productive procrastination' to learn about the terminal, shells, prompts and plugins to achieve a beautfil terminal. Proud to say I achieved both form and function on my little sidequest. Here's what it looks like now.
On Fri I was handed off a dashboard to update/maintain. The analyst combined excel files using python with a csv output . Then Tableau prep to join the data from the python output to data from SQL Server. The tableau prep flow output a csv which was then used by Power BI to create the dashboard.
January 26, 2025 at 9:59 PM
On Fri I was handed off a dashboard to update/maintain. The analyst combined excel files using python with a csv output . Then Tableau prep to join the data from the python output to data from SQL Server. The tableau prep flow output a csv which was then used by Power BI to create the dashboard.
Failure is an integral part of growth and learning.
January 20, 2025 at 4:15 PM
Failure is an integral part of growth and learning.
Some quick highlights on what I've learned/done in Module 1 of #DEzoomcamp. #dataBS
www.linkedin.com/posts/merarn...
www.linkedin.com/posts/merarn...
Mer Manahan on LinkedIn: #dataengineering #dezoomcamp #sql #docker
I've submitted the Week 1 homework assignment for the 2025 Data Engineering Zoomcamp. While the it didn't technically start until 1/13/25, I started working on…
www.linkedin.com
January 17, 2025 at 2:10 AM
Some quick highlights on what I've learned/done in Module 1 of #DEzoomcamp. #dataBS
www.linkedin.com/posts/merarn...
www.linkedin.com/posts/merarn...
This will be my thread/journal on the things I learn during the upcoming Data Engineering Zoomcamp.
For those interested in joining, here is the link to the Github repo
github.com/DataTalksClu...
For those interested in joining, here is the link to the Github repo
github.com/DataTalksClu...
GitHub - DataTalksClub/data-engineering-zoomcamp: Free Data Engineering course!
Free Data Engineering course! . Contribute to DataTalksClub/data-engineering-zoomcamp development by creating an account on GitHub.
github.com
January 13, 2025 at 2:31 AM
Setup a little dedicated study station in my house. Previously I was just on the couch distracted by the TV. Bought a desk lamp from Goodwill for $6. Was surprised when I found out only after I put a bulb in it that it had a USB-C port!!
January 12, 2025 at 4:43 PM
Setup a little dedicated study station in my house. Previously I was just on the couch distracted by the TV. Bought a desk lamp from Goodwill for $6. Was surprised when I found out only after I put a bulb in it that it had a USB-C port!!
Re-watched Interstellar last night. I want my own TARS.
January 10, 2025 at 7:59 PM
Re-watched Interstellar last night. I want my own TARS.
This will be my thread/journal on the things I learn during the upcoming Data Engineering Zoomcamp.
For those interested in joining, here is the link to the Github repo
github.com/DataTalksClu...
For those interested in joining, here is the link to the Github repo
github.com/DataTalksClu...
GitHub - DataTalksClub/data-engineering-zoomcamp: Free Data Engineering course!
Free Data Engineering course! . Contribute to DataTalksClub/data-engineering-zoomcamp development by creating an account on GitHub.
github.com
January 3, 2025 at 8:17 PM
This will be my thread/journal on the things I learn during the upcoming Data Engineering Zoomcamp.
For those interested in joining, here is the link to the Github repo
github.com/DataTalksClu...
For those interested in joining, here is the link to the Github repo
github.com/DataTalksClu...
TIL to batch load data from a csv to Postgres in a Docker container
January 3, 2025 at 3:28 AM
TIL to batch load data from a csv to Postgres in a Docker container
TIL that Claude is much faster at troubleshooting issues than my Google Fu ever will be.
January 1, 2025 at 7:58 PM
TIL that Claude is much faster at troubleshooting issues than my Google Fu ever will be.
Another day, another TIL Docker version.
One of the HW assignments of the Zoomcamp is to get used to Docker --help, specifically build --help. Was running into the issue of Experimental commands & flags hidden. Google Fu found
export BUILDX_EXPERIMENTAL=1
One of the HW assignments of the Zoomcamp is to get used to Docker --help, specifically build --help. Was running into the issue of Experimental commands & flags hidden. Google Fu found
export BUILDX_EXPERIMENTAL=1
December 31, 2024 at 2:58 PM
Another day, another TIL Docker version.
One of the HW assignments of the Zoomcamp is to get used to Docker --help, specifically build --help. Was running into the issue of Experimental commands & flags hidden. Google Fu found
export BUILDX_EXPERIMENTAL=1
One of the HW assignments of the Zoomcamp is to get used to Docker --help, specifically build --help. Was running into the issue of Experimental commands & flags hidden. Google Fu found
export BUILDX_EXPERIMENTAL=1
TIL that the docker daemon gets started when the docker engine on the docker desktop is started. I was trying to follow a video on simple docker operations and was getting the error that the daemon was not started. Docker Desktop as a terminal to run the commands that were previously failing.
December 30, 2024 at 8:54 PM
TIL that the docker daemon gets started when the docker engine on the docker desktop is started. I was trying to follow a video on simple docker operations and was getting the error that the daemon was not started. Docker Desktop as a terminal to run the commands that were previously failing.
TIL that I have a lot to learn when it comes to data engineering.
December 29, 2024 at 2:27 PM
TIL that I have a lot to learn when it comes to data engineering.
anyone else planning on going through the data engineering zoomcamp? #dataBS
github.com/DataTalksClu...
github.com/DataTalksClu...
GitHub - DataTalksClub/data-engineering-zoomcamp: Free Data Engineering course!
Free Data Engineering course! . Contribute to DataTalksClub/data-engineering-zoomcamp development by creating an account on GitHub.
github.com
December 28, 2024 at 2:55 PM
anyone else planning on going through the data engineering zoomcamp? #dataBS
github.com/DataTalksClu...
github.com/DataTalksClu...
A week of potty training starts today. Wish us luck!
December 21, 2024 at 1:23 PM
A week of potty training starts today. Wish us luck!
Slept almost 10 hours last night. Now just need some motivation to finish the year strong.
Maybe some Christmas music in the background?
What gets you motivated to kick ass at work?
Maybe some Christmas music in the background?
What gets you motivated to kick ass at work?
December 9, 2024 at 1:25 PM
Slept almost 10 hours last night. Now just need some motivation to finish the year strong.
Maybe some Christmas music in the background?
What gets you motivated to kick ass at work?
Maybe some Christmas music in the background?
What gets you motivated to kick ass at work?
@maninekkalapudi.io
How fitting is this post by Joe Reis given the call we just had
joereis.substack.com/p/the-power-...
How fitting is this post by Joe Reis given the call we just had
joereis.substack.com/p/the-power-...
The Power of Mentorship
Joe's Nerdy Rants #58 - Mentors matter, plus weekend reads and other stuff
joereis.substack.com
December 7, 2024 at 6:40 PM
@maninekkalapudi.io
How fitting is this post by Joe Reis given the call we just had
joereis.substack.com/p/the-power-...
How fitting is this post by Joe Reis given the call we just had
joereis.substack.com/p/the-power-...
Learn publicly.
Started the an online learning track for Associate Data Engineer.
1st sect was on general "What is Data Engineering?" followed by beginner SQL. Learned about INTERCEPT and EXCEPT. Two set operations I have never used. Also learned to use a subquery in the SELECT statement.
Started the an online learning track for Associate Data Engineer.
1st sect was on general "What is Data Engineering?" followed by beginner SQL. Learned about INTERCEPT and EXCEPT. Two set operations I have never used. Also learned to use a subquery in the SELECT statement.
December 2, 2024 at 7:58 PM
Learn publicly.
Started the an online learning track for Associate Data Engineer.
1st sect was on general "What is Data Engineering?" followed by beginner SQL. Learned about INTERCEPT and EXCEPT. Two set operations I have never used. Also learned to use a subquery in the SELECT statement.
Started the an online learning track for Associate Data Engineer.
1st sect was on general "What is Data Engineering?" followed by beginner SQL. Learned about INTERCEPT and EXCEPT. Two set operations I have never used. Also learned to use a subquery in the SELECT statement.