Why does L1 regularization induce sparse models? Many illustrate this using the least squares problem with a norm constraint. The least squares level sets are drawn next to the different unit "circles". I prepared a cool animation which I believe makes it even clearer 🙂


First 1e6 integers, represented as binary vectors indicating their prime factors, and laid out using the sparse matrix support in @leland_mcinnes's UMAP dimensionality reduction algorithm. This is from a 1000000x78628 (!) binary matrix. Very pretty structure emerges.

jhnhw's tweet image. First 1e6 integers, represented as binary vectors indicating their prime factors, and laid out using the sparse matrix support in @leland_mcinnes's UMAP dimensionality reduction algorithm. This is from a 1000000x78628 (!) binary matrix. Very pretty structure emerges.

“Sparse coding” extends to higher-level cognition as well, including the very narratives we accept into reality. In storytelling, narratives provide "sparse" data about characters, plots, or settings while our brains reconstruct the full experience. Predictive processing…

andrewknight's tweet image. “Sparse coding” extends to higher-level cognition as well, including the very narratives we accept into reality.

In storytelling, narratives provide "sparse" data about characters, plots, or settings while our brains reconstruct the full experience.

Predictive processing…

Arrays in Javascript in a nutshell: 1. What are Arrays? An array is a structured collection of values, where each value is assigned a unique index. These values can be of any data type, including numbers, strings, objects, and even other arrays. JavaScript arrays use…

ainasanghi's tweet image. Arrays in Javascript in a nutshell:

1. What are Arrays?

An array is a structured collection of values, where each value is assigned a unique index. 
These values can be of any data type, including numbers, strings, objects, and even other arrays.

JavaScript arrays use…
ainasanghi's tweet image. Arrays in Javascript in a nutshell:

1. What are Arrays?

An array is a structured collection of values, where each value is assigned a unique index. 
These values can be of any data type, including numbers, strings, objects, and even other arrays.

JavaScript arrays use…
ainasanghi's tweet image. Arrays in Javascript in a nutshell:

1. What are Arrays?

An array is a structured collection of values, where each value is assigned a unique index. 
These values can be of any data type, including numbers, strings, objects, and even other arrays.

JavaScript arrays use…
ainasanghi's tweet image. Arrays in Javascript in a nutshell:

1. What are Arrays?

An array is a structured collection of values, where each value is assigned a unique index. 
These values can be of any data type, including numbers, strings, objects, and even other arrays.

JavaScript arrays use…

Day 7 of JS30Xplore: 1. What are Arrays? An array is a structured collection of values, where each value is assigned a unique index. These values can be of any data type, including numbers, strings, objects, and even other arrays. JavaScript arrays use zero-based indexing,…

ainasanghi's tweet image. Day 7 of JS30Xplore:

1. What are Arrays?

An array is a structured collection of values, where each value is assigned a unique index. 
These values can be of any data type, including numbers, strings, objects, and even other arrays.

JavaScript arrays use zero-based indexing,…
ainasanghi's tweet image. Day 7 of JS30Xplore:

1. What are Arrays?

An array is a structured collection of values, where each value is assigned a unique index. 
These values can be of any data type, including numbers, strings, objects, and even other arrays.

JavaScript arrays use zero-based indexing,…
ainasanghi's tweet image. Day 7 of JS30Xplore:

1. What are Arrays?

An array is a structured collection of values, where each value is assigned a unique index. 
These values can be of any data type, including numbers, strings, objects, and even other arrays.

JavaScript arrays use zero-based indexing,…
ainasanghi's tweet image. Day 7 of JS30Xplore:

1. What are Arrays?

An array is a structured collection of values, where each value is assigned a unique index. 
These values can be of any data type, including numbers, strings, objects, and even other arrays.

JavaScript arrays use zero-based indexing,…

New Paper Alert!📄 "It’s better to be sparse than to be dense" ✨ We explore how to steer LLMs (like Gemma-2 2B & 9B) by modifying their activations in sparse spaces, enabling more precise, interpretable control & improved monosemanticity with scaling. Let’s break it down! 🧵

reza_byt's tweet image. New Paper Alert!📄

"It’s better to be sparse than to be dense" ✨

We explore how to steer LLMs (like Gemma-2 2B & 9B) by modifying their activations in sparse spaces, enabling more precise, interpretable control & improved monosemanticity with scaling.

Let’s break it down! 🧵

Still using #singlecell clustering algos on your #spatialomics data? Try BANKSY, a scalable, biologically motivated spatial #clustering tool that identifies both cell types and tissue domains: biorxiv.org/cgi/content/sh…

shyam_lab's tweet image. Still using #singlecell clustering algos on your #spatialomics data? Try BANKSY, a scalable, biologically motivated spatial #clustering tool that identifies both cell types and tissue domains: biorxiv.org/cgi/content/sh…

“A sparser graph leads to more polarization, and highway tolls remove edges.” - @apralky


🚀 #ScikitLearn 1.7 is here! ✅ Smarter #SparseArray support ⚠️ Improved #ConvergenceWarnings 🔢 Full #ArrayAPI integration Upgrade now: pip install --upgrade scikit-learn #MachineLearning #Python #AI #DataScience #MLTools

ai_syfer's tweet image. 🚀 #ScikitLearn 1.7 is here!
✅ Smarter #SparseArray support
⚠️ Improved #ConvergenceWarnings
🔢 Full #ArrayAPI integration

Upgrade now:
pip install --upgrade scikit-learn

#MachineLearning #Python #AI #DataScience #MLTools

LP-SparseMAP, my #icml2020 contribution with @andre_t_martins: sparse & structured hidden layers in the language of factor graphs. See how easy it is to define a differentiable dependency parsing layer with constraints on the max. n. modifiers (say, to prevent flat trees) 1/12

vnfrombucharest's tweet image. LP-SparseMAP, my #icml2020 contribution with @andre_t_martins: sparse & structured hidden layers in the language of factor graphs.

See how easy it is to define a differentiable dependency parsing layer with constraints on the max. n. modifiers (say, to prevent flat trees) 

1/12
vnfrombucharest's tweet image. LP-SparseMAP, my #icml2020 contribution with @andre_t_martins: sparse & structured hidden layers in the language of factor graphs.

See how easy it is to define a differentiable dependency parsing layer with constraints on the max. n. modifiers (say, to prevent flat trees) 

1/12

Illustration of the Lasso and its path in 2D: for t small enough, the solution is sparse!


A really cool memory allocation technique similar to compaction but for C. Mesh by @emeryberger and co. Great visual representation of the technique as well! arxiv.org/abs/1902.04738

__gparmer's tweet image. A really cool memory allocation technique similar to compaction but for C.  Mesh by @emeryberger and co.  Great visual representation of the technique as well!  arxiv.org/abs/1902.04738

one big Zustand performance mistake: `useShallow` array methods – it returns a cloned array, causing unnecessary re-renders

aidenybai's tweet image. one big Zustand performance mistake:

`useShallow` array methods – it returns a cloned array, causing unnecessary re-renders

Sparse matrix addition, from github.com/DrTimothyAlden… but also reguritated by copilot with "// sparse matrix add, cs_". My code on left, github on right.

DocSparse's tweet image. Sparse matrix addition, from github.com/DrTimothyAlden… but also reguritated by copilot with "// sparse matrix add, cs_".  My code on left, github on right.

Can we compress large language models for better perf? "SparseGPT: Massive Language Models can be Accurately Pruned in One Shot" Eliminates the need to use/store 50% of weights for a 175B param model with no significant sacrifice in perf arxiv.org/pdf/2301.00774… Here's how 👇

mathemagic1an's tweet image. Can we compress large language models for better perf?

"SparseGPT: Massive Language Models can be Accurately Pruned in One Shot"

Eliminates the need to use/store 50% of weights for a 175B param model with no significant sacrifice in perf

arxiv.org/pdf/2301.00774…

Here's how 👇

Design of Ultrasonic Synthetic Aperture Imaging Systems Based on a Non-Grid 2D Sparse Array mdpi.com/1424-8220/21/2… #sparsearray #syntheticapertureimaging #ultrasonicimaging

Sensors_MDPI's tweet image. Design of Ultrasonic Synthetic Aperture Imaging Systems Based on a Non-Grid 2D Sparse Array
mdpi.com/1424-8220/21/2…
#sparsearray #syntheticapertureimaging #ultrasonicimaging

🚀 #ScikitLearn 1.7 is here! ✅ Smarter #SparseArray support ⚠️ Improved #ConvergenceWarnings 🔢 Full #ArrayAPI integration Upgrade now: pip install --upgrade scikit-learn #MachineLearning #Python #AI #DataScience #MLTools

ai_syfer's tweet image. 🚀 #ScikitLearn 1.7 is here!
✅ Smarter #SparseArray support
⚠️ Improved #ConvergenceWarnings
🔢 Full #ArrayAPI integration

Upgrade now:
pip install --upgrade scikit-learn

#MachineLearning #Python #AI #DataScience #MLTools

Design of Ultrasonic Synthetic Aperture Imaging Systems Based on a Non-Grid 2D Sparse Array mdpi.com/1424-8220/21/2… #sparsearray #syntheticapertureimaging #ultrasonicimaging

Sensors_MDPI's tweet image. Design of Ultrasonic Synthetic Aperture Imaging Systems Based on a Non-Grid 2D Sparse Array
mdpi.com/1424-8220/21/2…
#sparsearray #syntheticapertureimaging #ultrasonicimaging

Como crear una clase Java que contenga multiples SparseArray? #contructor #java #sparsearray iteramos.com/c/70761


#android #sparsearray vs #hashmap. I think, it doesn't matter if your array size over than 10.000


@atla_ I got a lint warning once, which said to use #SparseArray instead of HashMap<Integer, String> ^^


You never stop learning stuff about your favorite language/sdk #SparseArray<> developer.android.com/reference/andr… :)


He, #Infragistics http://tinyurl.com/2c3sq resolves the nasty #SparseArray #bug, hope it helps!


Loading...

Something went wrong.


Something went wrong.


United States Trends