Ferenc Huszár
@inference.vc
Secular Bayesian.
Professor of Machine Learning at Cambridge Computer Lab
Talent aficionado at http://airetreat.org
Alum of Twitter, Magic Pony and Balderton Capital
Professor of Machine Learning at Cambridge Computer Lab
Talent aficionado at http://airetreat.org
Alum of Twitter, Magic Pony and Balderton Capital
Mathematical breakthrough of the year: Financial Times finally calculating the normalizing constant of the uniform distribution over ALL outcomes.
November 8, 2025 at 6:32 AM
Mathematical breakthrough of the year: Financial Times finally calculating the normalizing constant of the uniform distribution over ALL outcomes.
I’m very bad at getting things done but pretty good at making things happen. 🤷🏽♂️ How does this work?
November 1, 2025 at 9:06 PM
I’m very bad at getting things done but pretty good at making things happen. 🤷🏽♂️ How does this work?
My favourite vegan cream substitute is pasta water. Not only does it work better for pasta sauces, it reduces risk of death by assassination after your Italian friends learn that you put cream in carbonara…
November 1, 2025 at 2:55 PM
My favourite vegan cream substitute is pasta water. Not only does it work better for pasta sauces, it reduces risk of death by assassination after your Italian friends learn that you put cream in carbonara…
Thinking Machines co-founder Andrew Tulloch reported/rumoured to receive £3.5bn pay package over 5 years to rejoin Meta.
To put this into perspective, this would approximately cover Armenia's entire education budget (over the next 5 years).
Not accounting for income/capital gains taxes of course.
To put this into perspective, this would approximately cover Armenia's entire education budget (over the next 5 years).
Not accounting for income/capital gains taxes of course.
October 22, 2025 at 1:14 PM
Thinking Machines co-founder Andrew Tulloch reported/rumoured to receive £3.5bn pay package over 5 years to rejoin Meta.
To put this into perspective, this would approximately cover Armenia's entire education budget (over the next 5 years).
Not accounting for income/capital gains taxes of course.
To put this into perspective, this would approximately cover Armenia's entire education budget (over the next 5 years).
Not accounting for income/capital gains taxes of course.
Just realised how hopeless and inadequate it feels when - accidentally - I google for information instead of asking ChatGPT (equivalent).
Context: I was looking for a bedtime reading book that is complex, for preteens but structured as a collection of stand-alone episodes rather than one long novel
Context: I was looking for a bedtime reading book that is complex, for preteens but structured as a collection of stand-alone episodes rather than one long novel
October 22, 2025 at 7:23 AM
Just realised how hopeless and inadequate it feels when - accidentally - I google for information instead of asking ChatGPT (equivalent).
Context: I was looking for a bedtime reading book that is complex, for preteens but structured as a collection of stand-alone episodes rather than one long novel
Context: I was looking for a bedtime reading book that is complex, for preteens but structured as a collection of stand-alone episodes rather than one long novel
Is Pope Leo giving the NeurIPS keynote this year?
October 11, 2025 at 6:04 AM
Is Pope Leo giving the NeurIPS keynote this year?
When I applied to PhDs, I could derive the E-M algo
after 5 yrs of uni and I felt I stood out. Many applicants didn’t do much ML before.
This year, Miranda, barely out of high school starts her undergraduate with a NeurIPS spotlight, two AI olympiad medals, having bern to EEML 2x plus AI retreat 😨
after 5 yrs of uni and I felt I stood out. Many applicants didn’t do much ML before.
This year, Miranda, barely out of high school starts her undergraduate with a NeurIPS spotlight, two AI olympiad medals, having bern to EEML 2x plus AI retreat 😨
October 10, 2025 at 7:50 AM
When I applied to PhDs, I could derive the E-M algo
after 5 yrs of uni and I felt I stood out. Many applicants didn’t do much ML before.
This year, Miranda, barely out of high school starts her undergraduate with a NeurIPS spotlight, two AI olympiad medals, having bern to EEML 2x plus AI retreat 😨
after 5 yrs of uni and I felt I stood out. Many applicants didn’t do much ML before.
This year, Miranda, barely out of high school starts her undergraduate with a NeurIPS spotlight, two AI olympiad medals, having bern to EEML 2x plus AI retreat 😨
I like the sound of this common EU corporate entity idea!
Except quite clearly the virtual state shouldn’t be called “regime 28” but “regime 0” or failing that, “regime -1”.
Open for consultation until 30 Sept so take a look!
www.eu-inc.org
Except quite clearly the virtual state shouldn’t be called “regime 28” but “regime 0” or failing that, “regime -1”.
Open for consultation until 30 Sept so take a look!
www.eu-inc.org
EU–INC — One Europe. One Standard. — Pan-European legal entity.
EU–INC is a proposal for a pan-European standardized legal entity to unlock pan-European startup scaling.
www.eu-inc.org
September 27, 2025 at 6:24 PM
I like the sound of this common EU corporate entity idea!
Except quite clearly the virtual state shouldn’t be called “regime 28” but “regime 0” or failing that, “regime -1”.
Open for consultation until 30 Sept so take a look!
www.eu-inc.org
Except quite clearly the virtual state shouldn’t be called “regime 28” but “regime 0” or failing that, “regime -1”.
Open for consultation until 30 Sept so take a look!
www.eu-inc.org
Like a phoenix rising from the ashes,
like a turd that wouldn’t flush,
I re-emerge again in the geriatric Millennial basketball scene.
Wish me good health.
like a turd that wouldn’t flush,
I re-emerge again in the geriatric Millennial basketball scene.
Wish me good health.
September 26, 2025 at 1:54 PM
Like a phoenix rising from the ashes,
like a turd that wouldn’t flush,
I re-emerge again in the geriatric Millennial basketball scene.
Wish me good health.
like a turd that wouldn’t flush,
I re-emerge again in the geriatric Millennial basketball scene.
Wish me good health.
Mom, can we watch Star Wars?
Mom: We have Star Wars at home
Star wars at home:
Mom: We have Star Wars at home
Star wars at home:
September 18, 2025 at 8:08 PM
Mom, can we watch Star Wars?
Mom: We have Star Wars at home
Star wars at home:
Mom: We have Star Wars at home
Star wars at home:
We will have GPT6 before GTA6
September 10, 2025 at 7:28 PM
We will have GPT6 before GTA6
Reposted by Ferenc Huszár
I wrote an op-ed on the world-class STEM research ecosystem in the United States, and how this ecosystem is now under attack on multiple fronts by the current administration: newsletter.ofthebrave.org/p/im-an-awar...
I’m an award-winning mathematician. Trump just cut my funding.
The “Mozart of Math” tried to stay out of politics. Then it came for his research.
newsletter.ofthebrave.org
August 18, 2025 at 3:45 PM
I wrote an op-ed on the world-class STEM research ecosystem in the United States, and how this ecosystem is now under attack on multiple fronts by the current administration: newsletter.ofthebrave.org/p/im-an-awar...
OpenAI automated HR assistant
August 8, 2025 at 1:12 PM
OpenAI automated HR assistant
Arrived in Sarajevo for @eemlcommunity.bsky.social
Located in a narrow valley, it’s an ideal setting to get the momentum going in my deep learning talk later.
I’m keen to explore beyond the hotel coffee though which, one assumes, is carefully curated to highlight floral notes of a morning cigarette
Located in a narrow valley, it’s an ideal setting to get the momentum going in my deep learning talk later.
I’m keen to explore beyond the hotel coffee though which, one assumes, is carefully curated to highlight floral notes of a morning cigarette
July 21, 2025 at 6:09 AM
Arrived in Sarajevo for @eemlcommunity.bsky.social
Located in a narrow valley, it’s an ideal setting to get the momentum going in my deep learning talk later.
I’m keen to explore beyond the hotel coffee though which, one assumes, is carefully curated to highlight floral notes of a morning cigarette
Located in a narrow valley, it’s an ideal setting to get the momentum going in my deep learning talk later.
I’m keen to explore beyond the hotel coffee though which, one assumes, is carefully curated to highlight floral notes of a morning cigarette
Reposted by Ferenc Huszár
So you want to skip our thinning proofs—but you’d still like our out-of-the-box attention speedups? I’ll be presenting the Thinformer at two ICML workshop posters tomorrow!
Catch me at Es-FoMo (1-2:30, East hall A) and at LCFM (10:45-11:30 & 3:30-4:30, West 202-204)
Catch me at Es-FoMo (1-2:30, East hall A) and at LCFM (10:45-11:30 & 3:30-4:30, West 202-204)
Your data is low-rank, so stop wasting compute! In our new paper on low-rank thinning, we share one weird trick to speed up Transformer inference, SGD training, and hypothesis testing at scale. Come by ICML poster W-1012 Tuesday at 4:30!
New guarantees for approximating attention, accelerating SGD, and testing sample quality in near-linear time
July 19, 2025 at 7:04 AM
So you want to skip our thinning proofs—but you’d still like our out-of-the-box attention speedups? I’ll be presenting the Thinformer at two ICML workshop posters tomorrow!
Catch me at Es-FoMo (1-2:30, East hall A) and at LCFM (10:45-11:30 & 3:30-4:30, West 202-204)
Catch me at Es-FoMo (1-2:30, East hall A) and at LCFM (10:45-11:30 & 3:30-4:30, West 202-204)
BREAKING: OpenAI point guard Jason Wei joins Meta in shocking trade news. OpenAI receives two ConvNet researchers and a 2027 first-round draft pick. Veteran Yann LeCun rumored to be missing another season due to slow Achilles recovery. Apple “cautiously optimistic” about G-league chances.
July 16, 2025 at 12:22 PM
BREAKING: OpenAI point guard Jason Wei joins Meta in shocking trade news. OpenAI receives two ConvNet researchers and a 2027 first-round draft pick. Veteran Yann LeCun rumored to be missing another season due to slow Achilles recovery. Apple “cautiously optimistic” about G-league chances.
Reposted by Ferenc Huszár
Your data is low-rank, so stop wasting compute! In our new paper on low-rank thinning, we share one weird trick to speed up Transformer inference, SGD training, and hypothesis testing at scale. Come by ICML poster W-1012 Tuesday at 4:30!
New guarantees for approximating attention, accelerating SGD, and testing sample quality in near-linear time
July 14, 2025 at 6:29 PM
Your data is low-rank, so stop wasting compute! In our new paper on low-rank thinning, we share one weird trick to speed up Transformer inference, SGD training, and hypothesis testing at scale. Come by ICML poster W-1012 Tuesday at 4:30!
Low-Rank Thinning is presented tomorrow at ICML
⏰ Tue 15 Jul 4:30 - 7 p.m. PDT
icml.cc/virtual/2025...
⏰ Tue 15 Jul 4:30 - 7 p.m. PDT
icml.cc/virtual/2025...
July 14, 2025 at 5:48 PM
Low-Rank Thinning is presented tomorrow at ICML
⏰ Tue 15 Jul 4:30 - 7 p.m. PDT
icml.cc/virtual/2025...
⏰ Tue 15 Jul 4:30 - 7 p.m. PDT
icml.cc/virtual/2025...
Off to ICML next week?
Check out my student Annabelle’s paper in collaboration with @lestermackey.bsky.social and colleagues on low-rank thinning!
New theory, dataset compression, efficient attention and more:
arxiv.org/abs/2502.12063
Check out my student Annabelle’s paper in collaboration with @lestermackey.bsky.social and colleagues on low-rank thinning!
New theory, dataset compression, efficient attention and more:
arxiv.org/abs/2502.12063
Low-Rank Thinning
The goal in thinning is to summarize a dataset using a small set of representative points. Remarkably, sub-Gaussian thinning algorithms like Kernel Halving and Compress can match the quality of unifor...
arxiv.org
July 12, 2025 at 4:27 PM
Off to ICML next week?
Check out my student Annabelle’s paper in collaboration with @lestermackey.bsky.social and colleagues on low-rank thinning!
New theory, dataset compression, efficient attention and more:
arxiv.org/abs/2502.12063
Check out my student Annabelle’s paper in collaboration with @lestermackey.bsky.social and colleagues on low-rank thinning!
New theory, dataset compression, efficient attention and more:
arxiv.org/abs/2502.12063
They solved the alignment problem
Further tests reveal Grok 4 appears to consult Elon Musk's views on a range of sensitive topics, and its answers tend to align with Musk's personal opinions (Maxwell Zeff/TechCrunch)
Main Link | Techmeme Permalink
Main Link | Techmeme Permalink
July 11, 2025 at 6:53 AM
They solved the alignment problem
There once was a good man called Frederik
He landed a sweet job in Limerick
For fifty-six grand
He would teach on command
"Entschuldigung", "Tschüss" and "Ich liebe dich"
He landed a sweet job in Limerick
For fifty-six grand
He would teach on command
"Entschuldigung", "Tschüss" and "Ich liebe dich"
July 9, 2025 at 9:23 AM
There once was a good man called Frederik
He landed a sweet job in Limerick
For fifty-six grand
He would teach on command
"Entschuldigung", "Tschüss" and "Ich liebe dich"
He landed a sweet job in Limerick
For fifty-six grand
He would teach on command
"Entschuldigung", "Tschüss" and "Ich liebe dich"
Been awesome to meet @number10cat.bsky.social earlier today! My hero, the only constant among all the turmoil. Having served under 6 prime ministers, Olympics, Brexit. Loyal to no one, doesn’t give a fur ball about anything: the perfect role model for gen Z.
July 8, 2025 at 8:12 PM
Been awesome to meet @number10cat.bsky.social earlier today! My hero, the only constant among all the turmoil. Having served under 6 prime ministers, Olympics, Brexit. Loyal to no one, doesn’t give a fur ball about anything: the perfect role model for gen Z.
Rich get richer
The three emerging hubs for frontier AI jobs and wealth creation in Europe -- London - Zürich - Paris -- have already been the wealthiest cities in Europe by per capita GDP, wages and wealth.
Are there examples of newfound wealth creation by AI anywhere? Maybe UiPath in Bucharest?
The three emerging hubs for frontier AI jobs and wealth creation in Europe -- London - Zürich - Paris -- have already been the wealthiest cities in Europe by per capita GDP, wages and wealth.
Are there examples of newfound wealth creation by AI anywhere? Maybe UiPath in Bucharest?
June 30, 2025 at 4:02 PM
Rich get richer
The three emerging hubs for frontier AI jobs and wealth creation in Europe -- London - Zürich - Paris -- have already been the wealthiest cities in Europe by per capita GDP, wages and wealth.
Are there examples of newfound wealth creation by AI anywhere? Maybe UiPath in Bucharest?
The three emerging hubs for frontier AI jobs and wealth creation in Europe -- London - Zürich - Paris -- have already been the wealthiest cities in Europe by per capita GDP, wages and wealth.
Are there examples of newfound wealth creation by AI anywhere? Maybe UiPath in Bucharest?
Weymo is an interesting experience. Because there's no driver, every ride feels like it's the driver. Feels a bit like a loyal pet, because it's obviously not a person but has agency and your attribute some level of personality to it. A bit sad to let them go when a ride is over.
June 30, 2025 at 3:46 PM
Weymo is an interesting experience. Because there's no driver, every ride feels like it's the driver. Feels a bit like a loyal pet, because it's obviously not a person but has agency and your attribute some level of personality to it. A bit sad to let them go when a ride is over.
Are you in your 30s and being offered more than the entire f*ing LA Lakers for superintelligence research?
Take my advice: Get a notebook and write down all the hyperparameters and random details you still remember. Your memory wont be getting any better as you age.
Take my advice: Get a notebook and write down all the hyperparameters and random details you still remember. Your memory wont be getting any better as you age.
June 30, 2025 at 4:35 AM
Are you in your 30s and being offered more than the entire f*ing LA Lakers for superintelligence research?
Take my advice: Get a notebook and write down all the hyperparameters and random details you still remember. Your memory wont be getting any better as you age.
Take my advice: Get a notebook and write down all the hyperparameters and random details you still remember. Your memory wont be getting any better as you age.