Lightnews — Scholar-powered news

Christian Minich

@christiannolan.bsky.social

3.8K followers 2.2K following 1.8K posts

Dad, data, process, philosophy | Sales Eng @dagster | My wife says my headstone will read “sorry I’m late”

Posts Media Videos Starter Packs

Pinned

Christian Minich @christiannolan.bsky.social · Nov 7

Data people starter packs, parts 1 and 2. Gotta follow them all!

go.bsky.app/8TdEfdK

go.bsky.app/DsDyXF3

26 21 69

Reposted by Christian Minich

colton @colton.boo · 13h

Excited to be at All Things Open tomorrow!

Come hang out at the @dagster.io booth, or see my talk “Enabling education with a little help from AI” at 1:45 EST on Tuesday!

1 1 3

Christian Minich @christiannolan.bsky.social · 2d

Do you think one inspired the other?

1 1

Christian Minich @christiannolan.bsky.social · 2d

This is also a fantastic read on how to run ML at scale in Dagster.

Full blog post, recommended reading:

discord.com/blog/from-si...

2/2

From Single-Node to Multi-GPU Clusters: How Discord Made Distributed Compute Easy for ML Engineers

From manual GPU configs to one-command clusters: Join Serrana Aguirregaray and Nathaniel Jenkins as they tell the story of Discord's journey to build a developer-friendly ML infrastructure on Ray for ...

discord.com

Christian Minich @christiannolan.bsky.social · 2d

“And the system just works. One of our ML engineers built and launched a full testing framework in a day using the open-source docs from Ray and Dagster. No handholding needed, no custom tools, no waiting around — that’s what good infra unlocks.”

High praise for Dagster and Ray!

1/2

#dataBS

1 1

Christian Minich @christiannolan.bsky.social · 3d

What society would look like if everyone knew that being skilled at one thing does not make you skills at everything

1 3

Christian Minich @christiannolan.bsky.social · 5d

This is awesome! Really well thought out and useful

Reposted by Christian Minich

Matthew Mullins @mmullins.coginiti.co · 5d

We've open sourced QuackStore - a block-based caching extension for DuckDB! 🦆

QuackStore dramatically speeds up queries on remote data by intelligently caching only the blocks you need.

Now available as a DuckDB community extension: github.com/coginiti-dev...

GitHub - coginiti-dev/QuackStore

Contribute to coginiti-dev/QuackStore development by creating an account on GitHub.

github.com

3 4 20

Christian Minich @christiannolan.bsky.social · 5d

“Look for yes. It’s almost always there.”

Matches my experience, and why good communication is so important, especially at the intersection of different teams

boz.com/articles/loo...

Look For Yes

the conflict between groups tasked with managing risk and those tasked with making progress is legendary but both sides need to play a role in moving forward

boz.com

Christian Minich @christiannolan.bsky.social · 5d

Early in my career, I cultivated a spirit of “I know nothing.”

Now I try to do the much harder thing of accepting responsibility over areas I have unique skills in, while still trying to be curious and trying know what I don’t know.

“Know thyself” turns out to the final, forever boss.

a man is talking on a cell phone with the words " what i do have are a very particular set of skills " written below him

Alt: a man is talking on a cell phone with the words " what i do have are a very particular set of skills " written below him

media.tenor.com

Christian Minich @christiannolan.bsky.social · 9d

Yeah I have a Claude project where I uploaded a knowledge base (both code and documents) and it’s been super effective for searching over it, and I’ve been using Claude Code to help generate custom demos.

Both are huge time savers after of course the setup, but I think not every task is like that

Christian Minich @christiannolan.bsky.social · 9d

What types of tasks were you doing with them?

1 1

Christian Minich @christiannolan.bsky.social · 9d

dumb opinions strongly held

Christian Minich @christiannolan.bsky.social · 10d

YMMV, I saw it as a cliff’s notes version of what benefits you get + I love me any blog post with an underlying core repo.

I personally used a ✅ before LLMs sullied it but now I purge them from all of my writing 😬

Christian Minich @christiannolan.bsky.social · 10d

Code is amenable to LLMs because there’s a TON of open training data _and_ because you can test it / validate the output really well.

Not sure how you would achieve a thing remotely similar for spreadsheets, which famously don’t have an audit trail and whose computation lineage is opaque as hell

Christian Minich @christiannolan.bsky.social · 11d

There are a ton of posts about why x or y solution The Best, but my colleague Eric Thomas breaks it down: what concrete benefits might Dagster bring to your data pipelines?

Give it a gander (and clone the project and take it for a spin!): dagster.io/blog/buildin...

#dataBS

Modern Lakehouse Orchestration: Dagster vs Airflow Guide

Compare Airflow and Dagster for lakehouse orchestration. Discover event-driven processing, asset checks, and pure SQL patterns for MinIO, Trino, and Iceberg.

dagster.io

1 4

Christian Minich @christiannolan.bsky.social · 12d

It’s the closest I’ve ever come to being interested in bird watching

Christian Minich @christiannolan.bsky.social · 12d

This funny, irreverent yet earnest documentary on extreme birding was exactly the palate cleanser I needed

www.youtube.com/watch?v=zl-w...

LISTERS: A Glimpse Into Extreme Birdwatching

YouTube video by owen reiser

www.youtube.com

1 3

Christian Minich @christiannolan.bsky.social · 13d

Just clicked “undo” on an email I accidentally reply all’d to everyone in my company

a man wearing glasses is sitting on a couch with a spotify logo in the background

ALT: a man wearing glasses is sitting on a couch with a spotify logo in the background

media.tenor.com

Reposted by Christian Minich

Malcolm 朝精 Barrett @malcolmbarrett.malco.io · 13d

There are three kinds of lies: lies, damned lies, and

a checkbox on a website that says "keep me logged in"

3 8 43

Reposted by Christian Minich

Michael Paarlberg @mpaarlberg.bsky.social · 13d

I think the Trump admin assumed no one would try to find out who the people on the boats they blew up really were

350 5.7K 16K

Christian Minich @christiannolan.bsky.social · 13d

Online discourse about anything makes sense when you remember how few college kids Did the Reading and how few of those Understood the Reading

Christian Minich @christiannolan.bsky.social · 13d

Sales Engineers: find you a founder who loves and respects the SE craft they way Nick Schrock does.

“I love Sales Engineers … sales engineers know the truth. The right SE could have the keys to the castle.”

Hear the whole (excellent) podcast here:

overcast.fm/+AA4TR8cJQU0

Co-creator of GraphQL and Founder of Dagster Labs - Nick Schrock — Infinite Curiosity Pod with Prateek Joshi

Nick Schrock is the founder of Dagster Labs, a data platform that helps you build, schedule, and monitor reliable data pipelines. They’ve raised $49M in funding from investors such as Sequoia, Index, ...

overcast.fm

Reposted by Christian Minich

Adi Polak @adipolak.bsky.social · 15d

What advice would you give to someone in their twenties who wants to build a secure tech career?

6 2 2

Christian Minich @christiannolan.bsky.social · 16d

Or, what my broken fridge taught me about B2B SaaS

Christian Minich @christiannolan.bsky.social · 16d

I ordered a new washing machine within 5 minutes of realizing my old one was broken. I am extremely confident about the purchase, despite knowing approximately nothing about washing machines.

1/3

Christian Minich @christiannolan.bsky.social · 16d

This happened with me and my new fridge! But I did all the right due diligence and the sales guy mislead me.

It all worked out in the end but lesson learned