EMO: Pretraining mixture of experts for emergent modularity
•
22
AI & ML interests
Building breatkthrough AI to solve the world's biggest problems.
Recent Activity
View all activity
Papers
EMO: Pretraining Mixture of Experts for Emergent Modularity
MolmoAct2: Action Reasoning Models for Real-world Deployment
Articles
allenai/MolmoAct2-Think-LIBERO
Robotics • 5B • Updated • 54 • 3
allenai/MolmoAct2-LIBERO
Robotics • 5B • Updated • 86 • 2
allenai/MolmoAct2-DROID
Robotics • 5B • Updated • 82 • 4
allenai/MolmoAct2-SO100_101
Robotics • 5B • Updated • 188 • 7
allenai/MolmoAct2-BimanualYAM
Robotics • 5B • Updated • 1.11k • 3
allenai/MolmoAct2-Pretrain
Robotics • 5B • Updated • 55 • 3
allenai/MolmoAct2-Think
Robotics • 5B • Updated • 86 • 2
allenai/MolmoAct2
Robotics • 5B • Updated • 71 • 9
allenai/EMO
Text Generation • 14B • Updated • 16 • 4
allenai/StdMoE_1b14b_1T
Text Generation • 14B • Updated • 51 • 1
allenai/StdMoE_1b14b_130B
Text Generation • 14B • Updated • 38 • 1
allenai/StdMoE_1b4b_130B
Text Generation • 4B • Updated • 48 • 2
allenai/Emo_1b14b_130B
Text Generation • 14B • Updated • 100 • 2
allenai/Emo_1b14b_1T
Text Generation • 14B • Updated • 127 • 13
allenai/Dense_1b_130B
Text Generation • 1B • Updated • 129 • 2
allenai/StdMoE_1b14b_1T_EmoAnnealed
Text Generation • 14B • Updated • 15 • 1
allenai/StdMoE_1b14b_1T_Preanneal
Text Generation • 14B • Updated • 16 • 1
allenai/Molmo2-ER
Image-Text-to-Text • 5B • Updated • 74.1k • 9
allenai/MolmoAct2-FAST-Tokenizer
Robotics • Updated • 2
allenai/GraspMolmo
Robotics • 8B • Updated • 342 • 10
allenai/H_pre_LQK_32kv_8k_11k_SWA
Updated • 22 • 2
allenai/G_pre_8kv_8k_14k_SWA
Updated • 125
allenai/H_post_LQK_8kv_4k_11k_SWA
Updated • 92
allenai/G_post_LQK_8kv_4k_14k_SWA
Updated • 203
allenai/B_post_LQK_32kv_4k_11k
Updated • 93
allenai/K_post_HQK_8kv_12k
Updated • 202
allenai/H_post_LQK_32kv_8k_11k_SWA
Updated • 94
allenai/A_post_HQK_8kv_8k_13k_SWA_fp8
Updated • 89
allenai/H_post_LQK_32kv_8k_11k_SWA_fp8
Updated • 92
allenai/F_pre_8kv_8k_14k_SWA
Updated • 15