ThrunLab

university

Activity Feed Request to join this org

AI & ML interests

None defined yet.

authored a paper about 1 year ago

Mixture-of-Mamba: Enhancing Multi-Modal State-Space Models with Modality-Aware Sparsity

Paper • 2501.16295 • Published Jan 27, 2025 • 8

authored 2 papers over 1 year ago

Learning to (Learn at Test Time): RNNs with Expressive Hidden States

Paper • 2407.04620 • Published Jul 5, 2024 • 34

MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression

Paper • 2406.14909 • Published Jun 21, 2024 • 16

updated 17 models almost 2 years ago

thrunlab/sparse_llama_7b_hf2_refined_web_50p_2024-05-14

Updated May 14, 2024

thrunlab/sparse_llama_7b_hf2_refined_web_90p_2024-05-12

Text Generation • 7B • Updated May 12, 2024

thrunlab/sparse_llama_7b_hf2_refined_web_70p_2024-05-12

Updated May 12, 2024

thrunlab/sparse_llama_7b_hf2_refined_web_50p_2024-05-12

Text Generation • 7B • Updated May 12, 2024 • 1

thrunlab/relu_mistral_7b_refined_web_relu_2024-05-11

Updated May 11, 2024

thrunlab/sparse_mistral_7b_refined_web_50p_2024-05-11

Text Generation • 7B • Updated May 11, 2024 • 1

thrunlab/cats_exp

Text Generation • 7B • Updated May 11, 2024 • 2

thrunlab/sparse_llama_7b_hf2_refined_web_70p_2024-05-11

Updated May 11, 2024

thrunlab/sparse_llama_7b_hf2_refined_web_50p_2024-05-11

Text Generation • 7B • Updated May 11, 2024

thrunlab/sparse_mistral_7b_refined_web_90p_2024-05-11

Updated May 11, 2024

thrunlab/sparse_mistral_7b_refined_web_70p_2024-05-11

Updated May 11, 2024

thrunlab/relu_llama_7b_hf2_refined_web_relu_2024-05-11

Updated May 11, 2024

thrunlab/sparse_llama_7b_hf2_refined_web_90p_2024-05-11

Updated May 11, 2024

thrunlab/relu_mistral_7b_refined_web_relu_2024-04-14

Text Generation • 7B • Updated Apr 14, 2024

thrunlab/sparse_mistral_7b_refined_web_90p_2024-04-14

Updated Apr 14, 2024

thrunlab/sparse_mistral_7b_refined_web_70p_2024-04-14

Updated Apr 14, 2024

thrunlab/sparse_mistral_7b_refined_web_50p_2024-04-14

Text Generation • 7B • Updated Apr 14, 2024 • 2