Popular GitHub Repositories for Weight Sharing

The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We develop a method for analyzing emerging functional modularity in neural networks based on differentiable weight masks and use it to point out important issues in current-day neural networks.

CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing (ACL 2022)

Code Release for "Balanced Mixture of Supernets for Learning CNN Pooling", AutoML2023

Compressing deep neural networks with pruning, trained quantization and Huffman coding