Author | Lightnews

Daniel Falbel @dfalbel.bsky.social · 6d

This was really nice to watch #rstats :) Fun application of attention models. Also nice to see torch used for such important work! youtu.be/0Zra1WYoiOM?...

Keynote #2 R in the AI Era Leveraging Modern Technologies in Practice - Simon Urbanek

YouTube video by useR! Conference

youtu.be

5

Daniel Falbel @dfalbel.bsky.social · 7d

With a nice latent space vis ;)

1

Daniel Falbel @dfalbel.bsky.social · 7d

luz v0.5.1 is now on #rstats CRAN. Just a small bug fix related to forwarding `predict` parameters to the model. I also added a new Variational Autoencoder example to our examples gallery: mlverse.github.io/luz/articles...

Examples

mlverse.github.io

1 2 11

Daniel Falbel @dfalbel.bsky.social · 8d

As an #rstats dev, I never expected writing a PR to ipykernel :) github.com/ipython/ipyk... It's now running for everyone with ipykernel >= 7.1

Refer to kernel laucnhing thread instead of assuming the main thread by dfalbel · Pull Request #1455 · ipython/ipykernel

This PR proposes a patch to address the issue described in #1438 (comment) With this, we no longer asssume that the IPykernel app starts from the main thread. Instead, we keep a reference to the la...

github.com

9

Daniel Falbel @dfalbel.bsky.social · Sep 19

It has many limitations:

- no dynamic shapes
- hardcoded weights

But it should be possible to greatly improve this in the future.

1 1

Daniel Falbel @dfalbel.bsky.social · Sep 19

Where `resnet18_stablehlo.mlir` is a model exported with:

1 2

Daniel Falbel @dfalbel.bsky.social · Sep 19

Here's a small example:

1 3

Daniel Falbel @dfalbel.bsky.social · Sep 18

The motivation for it comes from working on inegrating
Apple embedding atlas into ragnar: github.com/tidyverse/ra...

We ended up using the python package, but we could have used a #rstats / JS only solution if we had some nice mosaic integration.

Embedding Atlas by dfalbel · Pull Request #124 · tidyverse/ragnar

Add support for visualizing the store using embedding-atlas

github.com

2

Daniel Falbel @dfalbel.bsky.social · Sep 18

Just made a nice website for mosaicr. A small #rstats htmlwidget package that allows using
@idl.uw.edu Mosaic data visualization framework from R.

The real power comes when embedding Mosaic plots within Shiny apps. See examples and docs in

dfalbel.github.io/mosaicr/

Scalable, Interactive Data Visualization

Produce scalable, interactive data visualization using the Mosaic framework.

dfalbel.github.io

1 1 10

Daniel Falbel @dfalbel.bsky.social · Sep 18

Yep! We have some work in github.com/r-xla
It's a long term project though. Theoretically it's already possible to create a graph in jax , export it to stablehlo and ecute it in R with no python dep.

r-xla

r-xla has 6 repositories available. Follow their code on GitHub.

github.com

1 4

Daniel Falbel @dfalbel.bsky.social · Aug 27

tiny ( <400loc) implementation of Gemma3 270M using torch for #rstats

github.com/mlverse/minh...

Includes support for loading weights from hugging face hub.

minhub/R/gemma3.R at main · mlverse/minhub

Minimal implementation of Deep Learning models. Contribute to mlverse/minhub development by creating an account on GitHub.

github.com

3 10

Daniel Falbel @dfalbel.bsky.social · Aug 27

tok is back on CRAN! tok is @hf.co tokenizers for #rstats. It uses the same Rust libray as the python interface. It's pretty fast and fully compatible with tokenizers.json available on hub.

See the release notes:

github.com/mlverse/tok/...

Release v0.2.0 · mlverse/tok

Updated upstream tokenizers to 0.20.3 Update extendr-api to 0.8.1

github.com

5 12

Reposted by Daniel Falbel

Edgar @theotheredgar.bsky.social · Dec 11

Dev 📦 alert! {lang} translates R help on-the-fly using your local LLM! It also overrides the `?` so you can easily access the translated docs and have them displayed on your IDE's help pane github.com/mlverse/lang #rstats #llm #ollama

GitHub - mlverse/lang: Uses LLMs to translate R help docs on the fly

Uses LLMs to translate R help docs on the fly. Contribute to mlverse/lang development by creating an account on GitHub.

github.com

6 18

Reposted by Daniel Falbel

Noam Ross @noamross.net · Dec 3

Excited and grateful that R-Universe is R Consortium's newest top-level project! This means sustained support for @rOpenSci.hachyderm.io.ap.brid.gy's platform for discovery and publishing of #rstats packages. Hats off to @jeroenooms.bsky.social for his leadership!

ropensci.org/blog/2024/12...

R-Universe Named R Consortium Top-Level Project

We're excited to announce R-Universe has been named the R-Consortium's newest Top-Level Project.

ropensci.org

28 72

Daniel Falbel @dfalbel.bsky.social · Nov 27

Happy to help making it work on MPS. It should just work if you create a tensor on the MPS device, using eg:

torch_randn(10,10, device="mps")

1

Daniel Falbel @dfalbel.bsky.social · Nov 27

torch for #rstats has reached 500 GitHub stars :)

4 4 46

Reposted by Daniel Falbel

Jenny Bryan @jennybryan.bsky.social · Nov 26

📦 usethis 3.1.0 📦 is released. `use_vignette()` and `use_article()` can now help you initiate a Quarto (.qmd) vignette or article. #rstats

usethis.r-lib.org/news/index.h...

Changelog

usethis.r-lib.org

4 31 120

Daniel Falbel @dfalbel.bsky.social · Nov 15

This is only happens on Linux when using the CPU. But many workflows involve transforming data on the CPU before executing the model on the GPU, so this fix should improve performance of most torch programs running on Linux!

1 2

Daniel Falbel @dfalbel.bsky.social · Nov 15

But LibTorch is really optimized to work with Intel MKL, and indeed statically links to a version of MKL for faster math kernels, but we were not using it leaving a lot of performance on the table.

1 1

Daniel Falbel @dfalbel.bsky.social · Nov 15

The problem was that previous versions of torch would use whatever BLAS library R is configured to use (which in most system will be a single threaded BLAS, and if you had some fun configuring R, it could be OpenBLAS.

1

Daniel Falbel @dfalbel.bsky.social · Nov 15

This includes a bug fix that makes #rstats torch at least 2x faster on Linux CPU's, and possibly even more for other workflows.

Daniel Falbel @dfalbel.bsky.social · Nov 14

Finally merged support for LibTorch 2.5 into #rstats torch main! github.com/mlverse/torc...

Libtorch 2.5.1 by dfalbel · Pull Request #1204 · mlverse/torch

Add support for LibTorch 2.5.1 TODO: Update Libtorch M1 builds - and patch the allocator Regenerate R level wrappers Figure out pre-built binaries for x86_64 macOS Drop unsupported CUDA from C...

github.com

1 4

Daniel Falbel @dfalbel.bsky.social · Nov 14

Finally merged support for LibTorch 2.5 into #rstats torch main! github.com/mlverse/torc...

Libtorch 2.5.1 by dfalbel · Pull Request #1204 · mlverse/torch

Add support for LibTorch 2.5.1 TODO: Update Libtorch M1 builds - and patch the allocator Regenerate R level wrappers Figure out pre-built binaries for x86_64 macOS Drop unsupported CUDA from C...

github.com

1 8

Daniel Falbel @dfalbel.bsky.social · Nov 13

Nice! Wrapping the bucket with a CDN, such as CloudFront, should also make downloads faster, due to regional caching and other optimizations that CDN's do. It also allows you to decouple the storage location from how things are distributed, so it gives you freedom to change storage structures later.

1

Daniel Falbel @dfalbel.bsky.social · Nov 13

I know nothing about nix, but how do folks download from the cache later? In general using a CloudFront distribution instead of directly accessing the bucket will reduce a lot the egress costs.

1

Daniel Falbel @dfalbel.bsky.social · Nov 13

After long investigation, I still don't understand what is really happening and what's wrong, but... The fix turned out being quite simple. Just had to add the RTLD_DEEPBIND flag when opening the dynamic library 🤷‍♂️

github.com/mlverse/torc...