Mat Kelcey
@matpalm.com
data nerd wannabe
https://matpalm.com/
https://matpalm.com/
Reposted by Mat Kelcey
At Imagine Innovators, we just announced our Developer Plan, offering expanded access to Edge Impulse’s powerful tools, completely free!
Get GPU training, longer runtimes, more projects, and production-ready licensing, all at zero cost.
Details: www.edgeimpulse.com/blog/introdu...
Get GPU training, longer runtimes, more projects, and production-ready licensing, all at zero cost.
Details: www.edgeimpulse.com/blog/introdu...
Introducing the Developer Plan: More Power, More Freedom — for Free
With our new Developer pricing plan you’ll now get the best of our community and professional plans. That means GPU training, longer runtimes, more projects, and production-ready licensing, all at zer...
www.edgeimpulse.com
May 6, 2025 at 5:47 PM
At Imagine Innovators, we just announced our Developer Plan, offering expanded access to Edge Impulse’s powerful tools, completely free!
Get GPU training, longer runtimes, more projects, and production-ready licensing, all at zero cost.
Details: www.edgeimpulse.com/blog/introdu...
Get GPU training, longer runtimes, more projects, and production-ready licensing, all at zero cost.
Details: www.edgeimpulse.com/blog/introdu...
Reposted by Mat Kelcey
It's about time I updated my recommended #FPGA links. Send me a suggestion this #FPGAFriday. 😊 projectf.io/recommended-...
Recommended FPGA Sites
This page collects some of my favourite FPGA resources from across the Internet.
FPGA Learning Resources Black Mesa Labs FPGA Tutorial Bruno Levy’s Learn FPGA fpga4fun.com fpgacpu.ca Nandland Project ...
projectf.io
March 21, 2025 at 9:58 AM
It's about time I updated my recommended #FPGA links. Send me a suggestion this #FPGAFriday. 😊 projectf.io/recommended-...
i wish this was always an option...
March 16, 2025 at 12:13 AM
i wish this was always an option...
still "finding" ( i.e. stepping on ) screws from the great M3 drawer spill of Sept '24
February 28, 2025 at 9:32 PM
still "finding" ( i.e. stepping on ) screws from the great M3 drawer spill of Sept '24
Reposted by Mat Kelcey
I'll take "n^2 - n cursed images" for $1000, Alec
It is Wizard Wednesday
February 13, 2025 at 6:21 AM
I'll take "n^2 - n cursed images" for $1000, Alec
Reposted by Mat Kelcey
Great interview with @jascha.sohldickstein.com about diffusion models! This is the first in a series: similar interviews with Yang Song and yours truly will follow soon.
(One of these is not like the others -- both of them basically invented the field, and I occasionally write a blog post 🥲)
(One of these is not like the others -- both of them basically invented the field, and I occasionally write a blog post 🥲)
History of Diffusion - Jascha Sohl-Dickstein
YouTube video by Bain Capital Ventures
www.youtube.com
February 10, 2025 at 10:28 PM
Great interview with @jascha.sohldickstein.com about diffusion models! This is the first in a series: similar interviews with Yang Song and yours truly will follow soon.
(One of these is not like the others -- both of them basically invented the field, and I occasionally write a blog post 🥲)
(One of these is not like the others -- both of them basically invented the field, and I occasionally write a blog post 🥲)
Reposted by Mat Kelcey
Making LLMs run efficiently can feel scary, but scaling isn’t magic, it’s math! We wanted to demystify the “systems view” of LLMs and wrote a little textbook called “How To Scale Your Model” which we’re releasing today. 1/n
February 4, 2025 at 6:54 PM
Making LLMs run efficiently can feel scary, but scaling isn’t magic, it’s math! We wanted to demystify the “systems view” of LLMs and wrote a little textbook called “How To Scale Your Model” which we’re releasing today. 1/n
"In what part of the world do you currently live?" lol
February 2, 2025 at 11:21 PM
"In what part of the world do you currently live?" lol
keep coming back to "Scalable MatMul-free Language Modeling" arxiv.org/abs/2406.02528
full of fun ideas! am slowly mapping my FPGA audio rate cached casual dilated convolutions network to operate using their mat mul free GLU version of self attention.
slowly getting there!
full of fun ideas! am slowly mapping my FPGA audio rate cached casual dilated convolutions network to operate using their mat mul free GLU version of self attention.
slowly getting there!
February 2, 2025 at 10:13 PM
keep coming back to "Scalable MatMul-free Language Modeling" arxiv.org/abs/2406.02528
full of fun ideas! am slowly mapping my FPGA audio rate cached casual dilated convolutions network to operate using their mat mul free GLU version of self attention.
slowly getting there!
full of fun ideas! am slowly mapping my FPGA audio rate cached casual dilated convolutions network to operate using their mat mul free GLU version of self attention.
slowly getting there!
ooffff! the "DeepSeek-V3 Technical Report" is info dense!
arxiv.org/abs/2412.19437
arxiv.org/abs/2412.19437
DeepSeek-V3 Technical Report
We present DeepSeek-V3, a strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token. To achieve efficient inference and cost-effective training, DeepS...
arxiv.org
January 27, 2025 at 10:11 PM
ooffff! the "DeepSeek-V3 Technical Report" is info dense!
arxiv.org/abs/2412.19437
arxiv.org/abs/2412.19437
still my fav "at doom's gate" cover!
( i'm probably 1K of those 2M views )
www.youtube.com/watch?v=TZG1...
( i'm probably 1K of those 2M views )
www.youtube.com/watch?v=TZG1...
DOOM: E1M1 (At Doom's Gate) - Metal Cover || RichaadEB & ToxicxEternity
YouTube video by RichaadEB
www.youtube.com
January 26, 2025 at 9:53 PM
still my fav "at doom's gate" cover!
( i'm probably 1K of those 2M views )
www.youtube.com/watch?v=TZG1...
( i'm probably 1K of those 2M views )
www.youtube.com/watch?v=TZG1...
went camping in an area with lots of eucalyptus and was surrounded by koalas! so cute!
January 21, 2025 at 10:24 AM
went camping in an area with lots of eucalyptus and was surrounded by koalas! so cute!
first logic gate waveshaper results tonight! this is network represented purely by combinational logic ( see arxiv.org/abs/2210.08277 ) i.e. just look up tables; no mults or adds. trained in jax ( 3 nested levels of vmap! ) & inference in amaranth. inference speed should be ~10s nanoseconds.
January 14, 2025 at 10:55 AM
first logic gate waveshaper results tonight! this is network represented purely by combinational logic ( see arxiv.org/abs/2210.08277 ) i.e. just look up tables; no mults or adds. trained in jax ( 3 nested levels of vmap! ) & inference in amaranth. inference speed should be ~10s nanoseconds.
and here i am trying to debug why param_set((2,3,16), seed=1) vs param_set((2,3,16), seed=2) isn't working... ::/
January 5, 2025 at 11:10 PM
and here i am trying to debug why param_set((2,3,16), seed=1) vs param_set((2,3,16), seed=2) isn't working... ::/
by a lot of measures this was a completely irrational purchase, but, you know what i like it! it's ok to be irrational some times.
January 5, 2025 at 9:39 PM
by a lot of measures this was a completely irrational purchase, but, you know what i like it! it's ok to be irrational some times.
started learning "Amaranth HDL" this morning. my prior FPGA neural net stuff was verilog but switching to amaranth since the match the gateware on a device i'm targetting. as someone with a python background it's 1e6 times nicer than verilog!!
January 5, 2025 at 9:30 PM
started learning "Amaranth HDL" this morning. my prior FPGA neural net stuff was verilog but switching to amaranth since the match the gateware on a device i'm targetting. as someone with a python background it's 1e6 times nicer than verilog!!
this board looks really fun!
"a small, low cost board with the Raspberry Pi Pico processor (RP2040) and a Lattice Semiconductor iCE40UP5K FPGA"
pico-ice.tinyvision.ai
"a small, low cost board with the Raspberry Pi Pico processor (RP2040) and a Lattice Semiconductor iCE40UP5K FPGA"
pico-ice.tinyvision.ai
December 30, 2024 at 8:46 AM
this board looks really fun!
"a small, low cost board with the Raspberry Pi Pico processor (RP2040) and a Lattice Semiconductor iCE40UP5K FPGA"
pico-ice.tinyvision.ai
"a small, low cost board with the Raspberry Pi Pico processor (RP2040) and a Lattice Semiconductor iCE40UP5K FPGA"
pico-ice.tinyvision.ai
"Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms".
interesting approach using 2nd order info to avoid the exploding/vanishing gradients that come from non differentiable relaxations..
www.youtube.com/watch?v=7aFP...
interesting approach using 2nd order info to avoid the exploding/vanishing gradients that come from non differentiable relaxations..
www.youtube.com/watch?v=7aFP...
Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms - NeurIPS2024
YouTube video by Felix Petersen
www.youtube.com
December 16, 2024 at 3:07 AM
"Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms".
interesting approach using 2nd order info to avoid the exploding/vanishing gradients that come from non differentiable relaxations..
www.youtube.com/watch?v=7aFP...
interesting approach using 2nd order info to avoid the exploding/vanishing gradients that come from non differentiable relaxations..
www.youtube.com/watch?v=7aFP...
this is super cool!! i'll definitely be porting my fpga wavenet ( matpalm.com/blog/wavenet... ) in the new year
December 13, 2024 at 12:23 AM
this is super cool!! i'll definitely be porting my fpga wavenet ( matpalm.com/blog/wavenet... ) in the new year
still the best tech speech ever.
"whatever path you're on, i advocate for long, hard work."
so, so true. knowledge & skills do not just pop into our heads, we have to push and shove and jam it in ourselves.
www.youtube.com/watch?v=YOZn...
"whatever path you're on, i advocate for long, hard work."
so, so true. knowledge & skills do not just pop into our heads, we have to push and shove and jam it in ourselves.
www.youtube.com/watch?v=YOZn...
John Carmack Receives Honorary Degree
YouTube video by UMKC School of Science and Engineering
youtu.be
December 12, 2024 at 9:48 PM
still the best tech speech ever.
"whatever path you're on, i advocate for long, hard work."
so, so true. knowledge & skills do not just pop into our heads, we have to push and shove and jam it in ourselves.
www.youtube.com/watch?v=YOZn...
"whatever path you're on, i advocate for long, hard work."
so, so true. knowledge & skills do not just pop into our heads, we have to push and shove and jam it in ourselves.
www.youtube.com/watch?v=YOZn...