@ehehdadaltd you have people from other #subnetworks of the #fediverse #replying your #post, can you read them?

Is knowledge located or distributed?

https://arxiv.org/abs/2310.03084

Delete ~1% of the parameters and

This is enough to remove knowledge but leave everything else functioning

#machinelearning #subnetworks #interpretabillity

Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks

Shiyu Liu, Rohan Ghosh, John Chong Min Tan, Mehul Motani

Action editor: Mingsheng Long.

https://openreview.net/forum?id=nGW2Hotpq3

#pruning #imagenet #subnetworks

On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons

Fangshuo Liao, Anastasios Kyrillidis

https://openreview.net/forum?id=e7mYYMSyZH

#neurons #subnetworks #regularization