Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
github.com/Blosc/python...
github.com/Blosc/python...
This introduces significant performance and memory optimizations, enhancing the experience of computing with large, compressed datasets using lazy expressions.
Compress Better, Compute Bigger!
#Performance #MemoryEfficiency #DataScience
This introduces significant performance and memory optimizations, enhancing the experience of computing with large, compressed datasets using lazy expressions.
Compress Better, Compute Bigger!
#Performance #MemoryEfficiency #DataScience
This release introduces the new blosc2.matmul() function. We have written a nice blog: www.blosc.org/posts/optimi...
Lastly, we are excited to introduce WASM32 wheels for the first time. More info at: github.com/Blosc/python...
Enjoy!
This release introduces the new blosc2.matmul() function. We have written a nice blog: www.blosc.org/posts/optimi...
Lastly, we are excited to introduce WASM32 wheels for the first time. More info at: github.com/Blosc/python...
Enjoy!
We've updated our recent blog post:
Check it out! 👇
www.blosc.org/posts/blosc2...
Compress Better, Compute Bigger
#Python #DataScience #Performance #OpenSource
We've updated our recent blog post:
Check it out! 👇
www.blosc.org/posts/blosc2...
Compress Better, Compute Bigger
#Python #DataScience #Performance #OpenSource
#Extra-Testing #x86_64
Origin | Interest | Match
#Extra-Testing #x86_64
Origin | Interest | Match
🚀 Outperforms NumPy by 10x ~ 100x for large computations
🐍 Integrates seamlessly with the Python data science ecosystem
💻 Works both in-memory and on-disk with minimal performance differences
ironarray.io/blog/compute...
🚀 Outperforms NumPy by 10x ~ 100x for large computations
🐍 Integrates seamlessly with the Python data science ecosystem
💻 Works both in-memory and on-disk with minimal performance differences
ironarray.io/blog/compute...
But you can always bypass this mechanism for more appropriate fine-tuning in different scenarios 🚀
www.blosc.org/python-blosc...
#Compression #Performance
But you can always bypass this mechanism for more appropriate fine-tuning in different scenarios 🚀
www.blosc.org/python-blosc...
#Compression #Performance
A step closer to compliance with the array-api standard: data-apis.org/array-api!
This is an effort across all array-based libraries so that your code works (e.g. for both blosc2 and NumPy) by simply changing the import statement below!
#arrayapi #Blosc2
A step closer to compliance with the array-api standard: data-apis.org/array-api!
This is an effort across all array-based libraries so that your code works (e.g. for both blosc2 and NumPy) by simply changing the import statement below!
#arrayapi #Blosc2
🔄 New blosc2.transpose()
⚡️ New fast path for NDArray.slice() - up to 40x speedup
🔧 NDArray.slice() now preserves compression params
📝 Improved documentation
Thanks to all contributors!
github.com/Blosc/python...
Compress Better, Compute Bigger! 😀
🔄 New blosc2.transpose()
⚡️ New fast path for NDArray.slice() - up to 40x speedup
🔧 NDArray.slice() now preserves compression params
📝 Improved documentation
Thanks to all contributors!
github.com/Blosc/python...
Compress Better, Compute Bigger! 😀
$ conda -c conda-forge install python-blosc2 mkl
will let you fully utilize your CPUs?
⏩ Advanced SIMD
⏩ Multiple cores
⏩ Leverage caches efficiently
www.blosc.org/python-blosc...
Do not let your hardware sit idle; put it to work for you. Kudos to @conda-forge.org team! 🤟
$ conda -c conda-forge install python-blosc2 mkl
will let you fully utilize your CPUs?
⏩ Advanced SIMD
⏩ Multiple cores
⏩ Leverage caches efficiently
www.blosc.org/python-blosc...
Do not let your hardware sit idle; put it to work for you. Kudos to @conda-forge.org team! 🤟
✨ Why memory-mapping?
1️⃣ No system call overhead for each read/write
2️⃣ Data goes straight from page cache to user space—much faster than traditional I/O!
👉 github.com/Blosc/python...
#DataScience #Performance #BigData 🚀💾
✨ Why memory-mapping?
1️⃣ No system call overhead for each read/write
2️⃣ Data goes straight from page cache to user space—much faster than traditional I/O!
👉 github.com/Blosc/python...
#DataScience #Performance #BigData 🚀💾
Check out compress-image: a new C++/Python library for working with compressed images directly in memory.
Kudos to Emil Dohne for this fantastic work!
Project here: github.com/EmilDohne/co...
#Blosc2 #FOSS #ImageProcessing
Check out compress-image: a new C++/Python library for working with compressed images directly in memory.
Kudos to Emil Dohne for this fantastic work!
Project here: github.com/EmilDohne/co...
#Blosc2 #FOSS #ImageProcessing
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
With the new compute engine in Python-Blosc2, you can! 😊 Check out our blog post for more details: ironarray.io/blog/compute...
Compress Better, Compute Bigger!
With the new compute engine in Python-Blosc2, you can! 😊 Check out our blog post for more details: ironarray.io/blog/compute...
Compress Better, Compute Bigger!
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. 💪
There's more to come, but what a fantastic milestone! ✨
A step closer to compliance with the array-api standard: data-apis.org/array-api!
This is an effort across all array-based libraries so that your code works (e.g. for both blosc2 and NumPy) by simply changing the import statement below!
#arrayapi #Blosc2
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. 💪
There's more to come, but what a fantastic milestone! ✨