Arthur Gretton
@arthurgretton.bsky.social
Looking forward to next week's Winter School on Causality and Explainable AI!
xai-winter-school.github.io
xai-winter-school.github.io
October 17, 2025 at 9:52 AM
Looking forward to next week's Winter School on Causality and Explainable AI!
xai-winter-school.github.io
xai-winter-school.github.io
Thank you for a fantastic conference!
Thank you very much @arthurgretton.bsky.social for your great talk!
September 5, 2025 at 10:31 AM
Thank you for a fantastic conference!
Sequential kernel embedding for mediated and time-varying dose response curves
Appearing in Bernoulli:
projecteuclid.org/journals/ber...
with preprint here: arxiv.org/abs/2111.03950
...along with code!
github.com/liyuan9988/K...
Rahul Singh, Liyuan Xu
Appearing in Bernoulli:
projecteuclid.org/journals/ber...
with preprint here: arxiv.org/abs/2111.03950
...along with code!
github.com/liyuan9988/K...
Rahul Singh, Liyuan Xu
August 11, 2025 at 2:18 PM
Sequential kernel embedding for mediated and time-varying dose response curves
Appearing in Bernoulli:
projecteuclid.org/journals/ber...
with preprint here: arxiv.org/abs/2111.03950
...along with code!
github.com/liyuan9988/K...
Rahul Singh, Liyuan Xu
Appearing in Bernoulli:
projecteuclid.org/journals/ber...
with preprint here: arxiv.org/abs/2111.03950
...along with code!
github.com/liyuan9988/K...
Rahul Singh, Liyuan Xu
Research Fellow position open at @gatsbyucl.bsky.social
to work with me and Jason Hartford on Causality in Biological Systems!
Apply at link, deadline is 27 August:
www.ucl.ac.uk/work-at-ucl/...
to work with me and Jason Hartford on Causality in Biological Systems!
Apply at link, deadline is 27 August:
www.ucl.ac.uk/work-at-ucl/...
UCL – University College London
UCL is consistently ranked as one of the top ten universities in the world (QS World University Rankings 2010-2022) and is No.2 in the UK for research power (Research Excellence Framework 2021).
www.ucl.ac.uk
August 9, 2025 at 6:49 PM
Research Fellow position open at @gatsbyucl.bsky.social
to work with me and Jason Hartford on Causality in Biological Systems!
Apply at link, deadline is 27 August:
www.ucl.ac.uk/work-at-ucl/...
to work with me and Jason Hartford on Causality in Biological Systems!
Apply at link, deadline is 27 August:
www.ucl.ac.uk/work-at-ucl/...
Accelerated Diffusion Models via Speculative Sampling, at #icml25 !
16:30 Tuesday July 15 poster E-3012
arxiv.org/abs/2501.05370
@vdebortoli.bsky.social Galashov @arnauddoucet.bsky.social
16:30 Tuesday July 15 poster E-3012
arxiv.org/abs/2501.05370
@vdebortoli.bsky.social Galashov @arnauddoucet.bsky.social
July 14, 2025 at 1:03 PM
Accelerated Diffusion Models via Speculative Sampling, at #icml25 !
16:30 Tuesday July 15 poster E-3012
arxiv.org/abs/2501.05370
@vdebortoli.bsky.social Galashov @arnauddoucet.bsky.social
16:30 Tuesday July 15 poster E-3012
arxiv.org/abs/2501.05370
@vdebortoli.bsky.social Galashov @arnauddoucet.bsky.social
Distributional diffusion models with scoring rules at #icml25
Fewer, larger denoising steps using distributional losses!
Wednesday 11am poster E-1910
arxiv.org/pdf/2502.02483
@vdebortoli.bsky.social
Galashov Guntupalli Zhou
@sirbayes.bsky.social
@arnauddoucet.bsky.social
Fewer, larger denoising steps using distributional losses!
Wednesday 11am poster E-1910
arxiv.org/pdf/2502.02483
@vdebortoli.bsky.social
Galashov Guntupalli Zhou
@sirbayes.bsky.social
@arnauddoucet.bsky.social
July 14, 2025 at 12:57 PM
Distributional diffusion models with scoring rules at #icml25
Fewer, larger denoising steps using distributional losses!
Wednesday 11am poster E-1910
arxiv.org/pdf/2502.02483
@vdebortoli.bsky.social
Galashov Guntupalli Zhou
@sirbayes.bsky.social
@arnauddoucet.bsky.social
Fewer, larger denoising steps using distributional losses!
Wednesday 11am poster E-1910
arxiv.org/pdf/2502.02483
@vdebortoli.bsky.social
Galashov Guntupalli Zhou
@sirbayes.bsky.social
@arnauddoucet.bsky.social
Reposted by Arthur Gretton
Distributional Reduction paper with H. Van Assel, @ncourty.bsky.social, T. Vayer , C. Vincent-Cuaz, and @pfrossard.bsky.social is accepted at TMLR. We show that both dimensionality reduction and clustering can be seen as minimizing an optimal transport loss 🧵1/5. openreview.net/forum?id=cll...
June 27, 2025 at 7:44 AM
Distributional Reduction paper with H. Van Assel, @ncourty.bsky.social, T. Vayer , C. Vincent-Cuaz, and @pfrossard.bsky.social is accepted at TMLR. We show that both dimensionality reduction and clustering can be seen as minimizing an optimal transport loss 🧵1/5. openreview.net/forum?id=cll...
Composite Goodness-of-fit Tests with Kernels, now out in JMLR!
www.jmlr.org/papers/v26/2...
Test if your distribution comes from ✨any✨ member of a parametric family. Comes in MMD and KSD flavours, and with code.
@oscarkey.bsky.social @fxbriol.bsky.social Tamara Fernandez
www.jmlr.org/papers/v26/2...
Test if your distribution comes from ✨any✨ member of a parametric family. Comes in MMD and KSD flavours, and with code.
@oscarkey.bsky.social @fxbriol.bsky.social Tamara Fernandez
Composite Goodness-of-fit Tests with Kernels
www.jmlr.org
June 5, 2025 at 10:54 PM
Composite Goodness-of-fit Tests with Kernels, now out in JMLR!
www.jmlr.org/papers/v26/2...
Test if your distribution comes from ✨any✨ member of a parametric family. Comes in MMD and KSD flavours, and with code.
@oscarkey.bsky.social @fxbriol.bsky.social Tamara Fernandez
www.jmlr.org/papers/v26/2...
Test if your distribution comes from ✨any✨ member of a parametric family. Comes in MMD and KSD flavours, and with code.
@oscarkey.bsky.social @fxbriol.bsky.social Tamara Fernandez
Turns out that overfitting is the right approach when you want to generalize to new tasks!
🚨 New paper accepted at SIMODS! 🚨
“Nonlinear Meta-learning Can Guarantee Faster Rates”
arxiv.org/abs/2307.10870
When does meta learning work? Spoiler: generalise to new tasks by overfitting on your training tasks!
Here is why:
🧵👇
“Nonlinear Meta-learning Can Guarantee Faster Rates”
arxiv.org/abs/2307.10870
When does meta learning work? Spoiler: generalise to new tasks by overfitting on your training tasks!
Here is why:
🧵👇
Nonlinear Meta-Learning Can Guarantee Faster Rates
Many recent theoretical works on \emph{meta-learning} aim to achieve guarantees in leveraging similar representational structures from related tasks towards simplifying a target task. The main aim of ...
arxiv.org
May 26, 2025 at 4:54 PM
Turns out that overfitting is the right approach when you want to generalize to new tasks!
Reposted by Arthur Gretton
Mattes Mollenhauer, Nicole M\"ucke, Dimitri Meunier, Arthur Gretton: Regularized least squares learning with heavy-tailed noise is minimax optimal https://arxiv.org/abs/2505.14214 https://arxiv.org/pdf/2505.14214 https://arxiv.org/html/2505.14214
May 21, 2025 at 6:14 AM
Mattes Mollenhauer, Nicole M\"ucke, Dimitri Meunier, Arthur Gretton: Regularized least squares learning with heavy-tailed noise is minimax optimal https://arxiv.org/abs/2505.14214 https://arxiv.org/pdf/2505.14214 https://arxiv.org/html/2505.14214
Looking forward to this!
#PAISS2025 summer school in the Alps with amazing speakers, including @dimadamen.bsky.social @arthurgretton.bsky.social @science4all.org @yann-lecun.bsky.social @gabrielpeyre.bsky.social @claireve.bsky.social and many more
▶️ Apply here: paiss.inria.fr/apply-2025/
▶️ Apply here: paiss.inria.fr/apply-2025/
The PAISS summer school is back with an incredible line of speakers (and more to come). Spread the word !
May 6, 2025 at 3:59 PM
Looking forward to this!
Kernel Single Proxy Control for Deterministic Confounding
at #AISTATS25
Proxy causal learning generally requires two proxy variables - a treatment and an outcome proxy. When is it possible to use just one?
arxiv.org/abs/2308.04585
Liyuan Xu
at #AISTATS25
Proxy causal learning generally requires two proxy variables - a treatment and an outcome proxy. When is it possible to use just one?
arxiv.org/abs/2308.04585
Liyuan Xu
May 2, 2025 at 11:51 PM
Kernel Single Proxy Control for Deterministic Confounding
at #AISTATS25
Proxy causal learning generally requires two proxy variables - a treatment and an outcome proxy. When is it possible to use just one?
arxiv.org/abs/2308.04585
Liyuan Xu
at #AISTATS25
Proxy causal learning generally requires two proxy variables - a treatment and an outcome proxy. When is it possible to use just one?
arxiv.org/abs/2308.04585
Liyuan Xu
Credal Two-Sample Tests of Epistemic Uncertainty
at #AISTATS25
Compare credal sets: convex sets of prob measures where elements capture aleatoric uncertainty; set represents epistemic uncertainty.
arxiv.org/abs/2410.12921
@slchau.bsky.social Schrab @sejdino.bsky.social @krikamol.bsky.social
at #AISTATS25
Compare credal sets: convex sets of prob measures where elements capture aleatoric uncertainty; set represents epistemic uncertainty.
arxiv.org/abs/2410.12921
@slchau.bsky.social Schrab @sejdino.bsky.social @krikamol.bsky.social
May 2, 2025 at 11:40 PM
Credal Two-Sample Tests of Epistemic Uncertainty
at #AISTATS25
Compare credal sets: convex sets of prob measures where elements capture aleatoric uncertainty; set represents epistemic uncertainty.
arxiv.org/abs/2410.12921
@slchau.bsky.social Schrab @sejdino.bsky.social @krikamol.bsky.social
at #AISTATS25
Compare credal sets: convex sets of prob measures where elements capture aleatoric uncertainty; set represents epistemic uncertainty.
arxiv.org/abs/2410.12921
@slchau.bsky.social Schrab @sejdino.bsky.social @krikamol.bsky.social
Spectral Representation for Causal Estimation with Hidden Confounders
at #AISTATS2025
A spectral method for causal effect estimation with hidden confounders, for instrumental variable and proxy causal learning
arxiv.org/abs/2407.10448
Haotian Sun, @antoine-mln.bsky.social, Tongzheng Ren, Bo Dai
at #AISTATS2025
A spectral method for causal effect estimation with hidden confounders, for instrumental variable and proxy causal learning
arxiv.org/abs/2407.10448
Haotian Sun, @antoine-mln.bsky.social, Tongzheng Ren, Bo Dai
May 2, 2025 at 12:36 PM
Spectral Representation for Causal Estimation with Hidden Confounders
at #AISTATS2025
A spectral method for causal effect estimation with hidden confounders, for instrumental variable and proxy causal learning
arxiv.org/abs/2407.10448
Haotian Sun, @antoine-mln.bsky.social, Tongzheng Ren, Bo Dai
at #AISTATS2025
A spectral method for causal effect estimation with hidden confounders, for instrumental variable and proxy causal learning
arxiv.org/abs/2407.10448
Haotian Sun, @antoine-mln.bsky.social, Tongzheng Ren, Bo Dai
Density Ratio-based Proxy Causal Learning Without Density Ratios 🤔
at #AISTATS2025
An alternative bridge function for proxy causal learning with hidden confounders.
arxiv.org/abs/2503.08371
Bozkurt, Deaner, @dimitrimeunier.bsky.social, Xu
at #AISTATS2025
An alternative bridge function for proxy causal learning with hidden confounders.
arxiv.org/abs/2503.08371
Bozkurt, Deaner, @dimitrimeunier.bsky.social, Xu
May 2, 2025 at 11:29 AM
Density Ratio-based Proxy Causal Learning Without Density Ratios 🤔
at #AISTATS2025
An alternative bridge function for proxy causal learning with hidden confounders.
arxiv.org/abs/2503.08371
Bozkurt, Deaner, @dimitrimeunier.bsky.social, Xu
at #AISTATS2025
An alternative bridge function for proxy causal learning with hidden confounders.
arxiv.org/abs/2503.08371
Bozkurt, Deaner, @dimitrimeunier.bsky.social, Xu
Reposted by Arthur Gretton
Announcing : The 2nd International Summer School on Mathematical Aspects of Data Science
mathsdata2025.github.io
EPFL, Sept 1–5, 2025
Speakers:
Bach @bachfrancis.bsky.social
Bandeira
Mallat
Montanari
Peyré @gabrielpeyre.bsky.social
For PhD students & early-career researchers
Apply before May 15!
mathsdata2025.github.io
EPFL, Sept 1–5, 2025
Speakers:
Bach @bachfrancis.bsky.social
Bandeira
Mallat
Montanari
Peyré @gabrielpeyre.bsky.social
For PhD students & early-career researchers
Apply before May 15!
Mathematical Aspects of Data Science
Graduate Summer School - EPFL - Sept. 1-5, 2025
mathsdata2025.github.io
April 14, 2025 at 5:00 PM
Announcing : The 2nd International Summer School on Mathematical Aspects of Data Science
mathsdata2025.github.io
EPFL, Sept 1–5, 2025
Speakers:
Bach @bachfrancis.bsky.social
Bandeira
Mallat
Montanari
Peyré @gabrielpeyre.bsky.social
For PhD students & early-career researchers
Apply before May 15!
mathsdata2025.github.io
EPFL, Sept 1–5, 2025
Speakers:
Bach @bachfrancis.bsky.social
Bandeira
Mallat
Montanari
Peyré @gabrielpeyre.bsky.social
For PhD students & early-career researchers
Apply before May 15!
Optimality and Adaptivity of Deep Neural Features for Instrumental Variable Regression
#ICLR25
openreview.net/forum?id=ReI...
NNs
✨better than fixed-feature (kernel, sieve) when target has low spatial homogeneity,
✨more sample-efficient wrt Stage 1
Kim, @dimitrimeunier.bsky.social, Suzuki, Li
#ICLR25
openreview.net/forum?id=ReI...
NNs
✨better than fixed-feature (kernel, sieve) when target has low spatial homogeneity,
✨more sample-efficient wrt Stage 1
Kim, @dimitrimeunier.bsky.social, Suzuki, Li
April 22, 2025 at 10:23 PM
Optimality and Adaptivity of Deep Neural Features for Instrumental Variable Regression
#ICLR25
openreview.net/forum?id=ReI...
NNs
✨better than fixed-feature (kernel, sieve) when target has low spatial homogeneity,
✨more sample-efficient wrt Stage 1
Kim, @dimitrimeunier.bsky.social, Suzuki, Li
#ICLR25
openreview.net/forum?id=ReI...
NNs
✨better than fixed-feature (kernel, sieve) when target has low spatial homogeneity,
✨more sample-efficient wrt Stage 1
Kim, @dimitrimeunier.bsky.social, Suzuki, Li
Deep MMD Gradient Flow Without Adversarial Training
at #ICLR2025
openreview.net/forum?id=Pf8...
Do you have a GAN critic? Then you have a diffusion!
Adaptive MMD gradient flow trained on a forward diffusion, competitive performance on image generation!
Galashov, @vdebortoli.bsky.social
at #ICLR2025
openreview.net/forum?id=Pf8...
Do you have a GAN critic? Then you have a diffusion!
Adaptive MMD gradient flow trained on a forward diffusion, competitive performance on image generation!
Galashov, @vdebortoli.bsky.social
April 22, 2025 at 10:08 PM
Deep MMD Gradient Flow Without Adversarial Training
at #ICLR2025
openreview.net/forum?id=Pf8...
Do you have a GAN critic? Then you have a diffusion!
Adaptive MMD gradient flow trained on a forward diffusion, competitive performance on image generation!
Galashov, @vdebortoli.bsky.social
at #ICLR2025
openreview.net/forum?id=Pf8...
Do you have a GAN critic? Then you have a diffusion!
Adaptive MMD gradient flow trained on a forward diffusion, competitive performance on image generation!
Galashov, @vdebortoli.bsky.social
Looking forward to this!
Applications are 📣OPEN📣 for #PAISS2025 THE AI summer school in #Grenoble 1-5 Sept! Speakers so far @yann-lecun.bsky.social @dimadamen.bsky.social @arthurgretton.bsky.social @gabrielpeyre.bsky.social @science4all.org A. Cristia J. Revaud M. Caron J. Carpentier M. Vladimirova ➡️ paiss.inria.fr
April 15, 2025 at 10:55 PM
Looking forward to this!
Reposted by Arthur Gretton
Our joint paper with Geoffrey Wolfer @gwolfer.bsky.social "Variance-Aware Estimation of the Kernel Mean Embedding" accepted for publication in the Journal of Machine Learning Research 🥳
arxiv.org/abs/2210.06672
arxiv.org/abs/2210.06672
Variance-Aware Estimation of Kernel Mean Embedding
An important feature of kernel mean embeddings (KME) is that the rate of convergence of the empirical KME to the true distribution KME can be bounded independently of the dimension of the space, prope...
arxiv.org
March 12, 2025 at 3:16 AM
Our joint paper with Geoffrey Wolfer @gwolfer.bsky.social "Variance-Aware Estimation of the Kernel Mean Embedding" accepted for publication in the Journal of Machine Learning Research 🥳
arxiv.org/abs/2210.06672
arxiv.org/abs/2210.06672
Congratulations @lestermackey.bsky.social !!
Congratulations to @lestermackey.bsky.social for receiving the 2025 COPSS Award! 🎉👏
Lester is currently the Chair of the Section on Bayesian Statistical Sciences (SBSS) of the American Statistical Association.
Lester is currently the Chair of the Section on Bayesian Statistical Sciences (SBSS) of the American Statistical Association.
March 8, 2025 at 7:34 AM
Congratulations @lestermackey.bsky.social !!
Reposted by Arthur Gretton
Hey ELLIS PhD students, need to travel but low on funds? Learn how ELSA can help with that: bit.ly/4kqjyel
#ELLISPhD #MobilityFund #SustainableAI #ProjectsBuildingOnELLIS
#ELLISPhD #MobilityFund #SustainableAI #ProjectsBuildingOnELLIS
Travel the world with ELSA: our Mobility Fund in Action – ELSA
bit.ly
March 6, 2025 at 3:34 PM
Hey ELLIS PhD students, need to travel but low on funds? Learn how ELSA can help with that: bit.ly/4kqjyel
#ELLISPhD #MobilityFund #SustainableAI #ProjectsBuildingOnELLIS
#ELLISPhD #MobilityFund #SustainableAI #ProjectsBuildingOnELLIS
Reposted by Arthur Gretton
I already advertised for this document when I posted it on arXiv, and later when it was published.
This week, with the agreement of the publisher, I uploaded the published version on arXiv.
Less typos, more references and additional sections including PAC-Bayes Bernstein.
arxiv.org/abs/2110.11216
This week, with the agreement of the publisher, I uploaded the published version on arXiv.
Less typos, more references and additional sections including PAC-Bayes Bernstein.
arxiv.org/abs/2110.11216
March 5, 2025 at 1:16 AM
I already advertised for this document when I posted it on arXiv, and later when it was published.
This week, with the agreement of the publisher, I uploaded the published version on arXiv.
Less typos, more references and additional sections including PAC-Bayes Bernstein.
arxiv.org/abs/2110.11216
This week, with the agreement of the publisher, I uploaded the published version on arXiv.
Less typos, more references and additional sections including PAC-Bayes Bernstein.
arxiv.org/abs/2110.11216
Reposted by Arthur Gretton
The slides of my talk at OIST are online: pierrealquier.github.io/slides/okina...
Thanks to the organisers, and thanks to Frank Nielsen for the photo of my talk 🙏
Link to the paper: arxiv.org/abs/2412.18539
Thanks to the organisers, and thanks to Frank Nielsen for the photo of my talk 🙏
Link to the paper: arxiv.org/abs/2412.18539
March 4, 2025 at 4:31 AM
The slides of my talk at OIST are online: pierrealquier.github.io/slides/okina...
Thanks to the organisers, and thanks to Frank Nielsen for the photo of my talk 🙏
Link to the paper: arxiv.org/abs/2412.18539
Thanks to the organisers, and thanks to Frank Nielsen for the photo of my talk 🙏
Link to the paper: arxiv.org/abs/2412.18539
Video now public from the talk
"Learning to act in noisy contexts using deep proxy learning"
at the NeurIPS'24 Workshop on Causal Representation Learning!
Video:
neurips.cc/virtual/2024...
Slides:
www.gatsby.ucl.ac.uk/~gretton/cou...
"Learning to act in noisy contexts using deep proxy learning"
at the NeurIPS'24 Workshop on Causal Representation Learning!
Video:
neurips.cc/virtual/2024...
Slides:
www.gatsby.ucl.ac.uk/~gretton/cou...
March 4, 2025 at 5:12 AM
Video now public from the talk
"Learning to act in noisy contexts using deep proxy learning"
at the NeurIPS'24 Workshop on Causal Representation Learning!
Video:
neurips.cc/virtual/2024...
Slides:
www.gatsby.ucl.ac.uk/~gretton/cou...
"Learning to act in noisy contexts using deep proxy learning"
at the NeurIPS'24 Workshop on Causal Representation Learning!
Video:
neurips.cc/virtual/2024...
Slides:
www.gatsby.ucl.ac.uk/~gretton/cou...