Working on Espresso: A metacircular Java bytecode interpreter for GraalVM.
Java in Java by day, LLMs in Java by night.
It includes the very public first demo of Project Crema, Open World for Native Image, at 2:19:54 😅
Thank you, @devoxx.com!
All demos and notes are here: github.com/alina-yur/gr...
It includes the very public first demo of Project Crema, Open World for Native Image, at 2:19:54 😅
Thank you, @devoxx.com!
All demos and notes are here: github.com/alina-yur/gr...
www.youtube.com/shorts/7zSEa...
www.youtube.com/shorts/7zSEa...
✅ Llama3.java
✅ Vector API, FFM API
✅ Apple Silicon ❤️
— `git clone github.com/mukel/llama3... `
— `sdk install java 25.ea.17-graal`
— `make native` (optionally preload a model for zero overhead)
— Profit!🚀
#Java #GraalVM #LLM #LLama
✅ Llama3.java
✅ Vector API, FFM API
✅ Apple Silicon ❤️
— `git clone github.com/mukel/llama3... `
— `sdk install java 25.ea.17-graal`
— `make native` (optionally preload a model for zero overhead)
— Profit!🚀
#Java #GraalVM #LLM #LLama
Already looking forward to part 2.
Already looking forward to part 2.
Try it out here: github.com/mukel/llama3...
@stephanjanssen.be @mukel.bsky.social
#VDCERN #VoxxedDaysCERN
Try it out here: github.com/mukel/llama3...
@stephanjanssen.be @mukel.bsky.social
#VDCERN #VoxxedDaysCERN
This will soon provide developers with the same debugging experience they are used to in Java, but for native images! Stay tuned for more details.
github.com/oracle/graal...
This will soon provide developers with the same debugging experience they are used to in Java, but for native images! Stay tuned for more details.
github.com/oracle/graal...
This will soon provide developers with the same debugging experience they are used to in Java, but for native images! Stay tuned for more details.
github.com/oracle/graal...
cern.voxxeddays.com/talk/the-era...
cern.voxxeddays.com/talk/the-era...
Graal compiler: +10% faster inference with the latest early access build.
New features: batched prompt processing & AVX512 support.
Graal compiler: +10% faster inference with the latest early access build.
New features: batched prompt processing & AVX512 support.