lshaw_ironarray's profile picture.

Luke Shaw

@lshaw_ironarray

📢Blosc2 3.10.2 Released! 📢 Lazy evaluation for ALL Blosc2 functions in version 3.10! Blosc2 powers: - Zarr/HDF5 computations (see image and blosc.org/posts/tensordo…) - Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)! #Zarr #HDF5 #Python

lshaw_ironarray's tweet image. 📢Blosc2 3.10.2 Released!  📢

Lazy evaluation for ALL Blosc2 functions in version 3.10!

Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensordo…)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!

#Zarr 
#HDF5 
#Python

🚨Blosc2 3.9.1🚨 • Array API standard compliance - 70 new functions • Fast linalg: tensordot up to 12x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy for large arrays ! • Fast num calc: Funcs like hypot 10x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy! Blog: ironarray.io/blog/array-api #Python #linalg #computation

lshaw_ironarray's tweet image. 🚨Blosc2 3.9.1🚨 

• Array API standard compliance - 70 new functions
• Fast linalg: tensordot up to 12x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy for large arrays ! 
• Fast num calc: Funcs like hypot 10x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy!

Blog: ironarray.io/blog/array-api

#Python
#linalg
#computation

Luke Shaw 已转帖

Exciting news! Python-Blosc2 is making huge strides towards array-api compliance. 🚀 You can now use it as a drop-in replacement for NumPy to operate efficiently on compressed data. 🗜️💪 There's more to come, but what a fantastic milestone! ✨

🗣️ Announcing Python-Blosc2 3.8.0 🚀 A step closer to compliance with the array-api standard: data-apis.org/array-api! The goal: your code works for all array libraries (e.g. for both blosc2 and NumPy) by simply changing the import statement below! #arrayapi #Blosc2

lshaw_ironarray's tweet image. 🗣️ Announcing Python-Blosc2 3.8.0 🚀  

A step closer to compliance with the array-api standard: data-apis.org/array-api!  
The goal: your code works  for all array libraries (e.g. for both blosc2 and NumPy) by simply changing the import statement below!  #arrayapi #Blosc2


🗣️ Announcing Python-Blosc2 3.8.0 🚀 A step closer to compliance with the array-api standard: data-apis.org/array-api! The goal: your code works for all array libraries (e.g. for both blosc2 and NumPy) by simply changing the import statement below! #arrayapi #Blosc2

lshaw_ironarray's tweet image. 🗣️ Announcing Python-Blosc2 3.8.0 🚀  

A step closer to compliance with the array-api standard: data-apis.org/array-api!  
The goal: your code works  for all array libraries (e.g. for both blosc2 and NumPy) by simply changing the import statement below!  #arrayapi #Blosc2

Luke Shaw 已转帖

Looking forward to meet folks for an exciting tutorial on efficient compression, large computations and other musings. See you in Krakow!

📢 Hands-on #EuroSciPy2025 Tutorial: Compress, Compute, Conquer! with @FrancescAlted + Luke Shaw! 🚀 Learn to process datasets 100x bigger than RAM using Python-Blosc2's new compute engine. 🧠 90 minutes of big-data magic. 🗓️ euroscipy.org/schedule #Python #DataScience #HPC

euroscipy.org

EuroSciPy 2025 Schedule

EuroSciPy 2025 Schedule



Luke Shaw 已转帖

Struggling with slow I/O in #HDF5? Try #Blosc2 as a filter or I/O data handler — faster data, less pain! 👉 blosc.org/posts/pytables… #Performance #DataScience

FrancescAlted's tweet image. Struggling with slow I/O in #HDF5? Try #Blosc2 as a filter or I/O data handler — faster data, less pain!

👉 blosc.org/posts/pytables…

#Performance #DataScience

Luke Shaw 已转帖

🗣️ Announcing Python-Blosc2 3.5.1 🚀This introduces significant performance and memory optimizations, enhancing the experience of computing with large, compressed datasets using lazy expressions. Compress Better, Compute Bigger! #Performance #MemoryEfficiency #DataScience

FrancescAlted's tweet image. 🗣️ Announcing Python-Blosc2 3.5.1 🚀This introduces significant performance and memory optimizations, enhancing the experience of computing with large, compressed datasets using lazy expressions.  

Compress Better, Compute Bigger!

#Performance #MemoryEfficiency #DataScience

Luke Shaw 已转帖

For those who could not attend, the recording of our webinar, "A Gentle Introduction to Cat2Cloud," is now available! ironarray.io/cat2cloud#webi… If interested, remember that the subscription to our beta program is currently open! Compress Better, Compute Bigger, Share Faster!

FrancescAlted's tweet image. For those who could not attend, the recording of our webinar, "A Gentle Introduction to Cat2Cloud," is now available!

ironarray.io/cat2cloud#webi…

If interested, remember that the subscription to our beta program is currently open!

Compress Better, Compute Bigger, Share Faster!

Luke Shaw 已转帖

#Blosc2 now runs directly in your browser! Leveraging the power of #WASM, #Pyodide, and #JupyterLite, you can harness efficient compression through the web's universal interface. Compress Better, Compute Bigger, Share Faster #DataCompression #WebDevelopment #DataScience

FrancescAlted's tweet image. #Blosc2 now runs directly in your browser! Leveraging the power of #WASM, #Pyodide, and #JupyterLite, you can harness efficient compression through the web's universal interface.

Compress Better, Compute Bigger, Share Faster

#DataCompression #WebDevelopment #DataScience

Luke Shaw 已转帖

Thanks to the advanced double partitioning techniques in #Blosc2, our #Caterva2 package can serve small slices of big datasets (3.8 GB) through internet in less than the blink of an eye. Try it out! 👉 cat2.cloud/demo/roots/@pu… Share Faster! #BigData #RemoteAccess #Performance


Luke Shaw 已转帖

Second cat2cloud introductory video! 🥳 Optimise file transfer ⚡ and access for server-hosted data 📅 with cat2cloud's compression-first framework Minimise transfer times and storage requirements 🗜️! See more at ironarray.io/cat2cloud! #API #datascience #compression #jupyter


Luke Shaw 已转帖

🚀 Compute Bigger with Cat2Cloud Compression! 🗜️ In this third video, we explore lazy expressions 😴— a compression-native tool to optimize operations on your data using the Cat2Cloud web client. 🌐 👉 Try it out here: cat2.cloud/demo 🔗 ironarray.io/cat2cloud 👀


Did you know Caterva2 has native support for HDF5 files 📂 ? At ironArray we are constantly working 🛠️ to offer an improved product to our users - learn how the unfold 📖 command can expose your .h5 files to Caterva2's powerful analysis toolkit 🧰 - > ironarray.io/caterva2

lshaw_ironarray's tweet image. Did you know Caterva2 has native support for HDF5 files 📂 ? At ironArray we are constantly working 🛠️ to offer an improved product to our users - learn how the unfold 📖 command can expose your .h5 files to Caterva2's powerful analysis toolkit 🧰 - > ironarray.io/caterva2

Luke Shaw 已转帖

Cat2Cloud Video 5! We connect the Single Source of Truth (SSoT) concept to lazy expressions and Cat2Cloud's powerful append. We also see how to seamlessly switch between notebooks and the web client. Full video : ironarray.wistia.com/medias/4uepth8… Find out more: ironarray.io/cat2cloud


Luke Shaw 已转帖

Our **4th video** on **Cat2Cloud** is now live! 🎉 **Optimize your data analysis pipelines** using **lazy expressions** in Jupyter Notebooks. 📊✨ Seamlessly combine **local 🖥️ and remote 🌐 data processing** 💾⚡ 👉 Full video ironarray.io/cat2cloud


Caterva2 also supports filtering 🗃️data with fields, via the web client 🌐 or programmatically from Python code 🐍! This makes it ideal for structured datasets for Data Science 🧪. See 👀 what Caterva2 can do !-> ironarray.io/caterva2. #DataScience #Python

lshaw_ironarray's tweet image. Caterva2 also supports filtering 🗃️data with fields, via the web client 🌐 or programmatically from Python code 🐍! This makes it ideal for structured datasets for Data Science 🧪. See 👀 what Caterva2 can do !-> ironarray.io/caterva2. #DataScience #Python

Luke Shaw 已转帖

Blosc2 just launched a super-efficient array concatenation feature! 🥳 Combine massive arrays quickly and with minimal memory. Check out our blog post: blosc.org/posts/blosc2-n… Compress Better, Compute Bigger

FrancescAlted's tweet image. Blosc2 just launched a super-efficient array concatenation feature! 🥳

Combine massive arrays quickly and with minimal memory. Check out our blog post: blosc.org/posts/blosc2-n…

Compress Better, Compute Bigger

United States 趋势

Loading...

Something went wrong.


Something went wrong.