Lukas Galke

lgalke

https://lgalke.github.io

AI & ML interests

Representation learning; pre-training; quantization; continual learning; probing; multilingual pre-training; knowledge tracing/discovering/inducing

Recent Activity

updated a collection 24 days ago

Moltbook Models

updated a collection 24 days ago

Moltbook Models

updated a collection 24 days ago

Moltbook Models

View all activity

Organizations

upvoted a collection about 2 months ago

Activation Oracles

Collection

12 items • Updated Dec 26, 2025 • 18

upvoted a paper 7 months ago

Guarded Query Routing for Large Language Models

Paper • 2505.14524 • Published May 20, 2025 • 2

upvoted a paper 10 months ago

Dynaword: From One-shot to Continuously Developed Datasets

Paper • 2508.02271 • Published Aug 4, 2025 • 15

upvoted an article about 1 year ago

Article

Finally, a Replacement for BERT: Introducing ModernBERT

bwarner, NohTow, bclavie, orionweller, ohallstrom, staghado, alexisgallagher, rbiswasfc, fladhak, tomaarsen, ncoop57, griffin, jph00, johnowhitaker, iacolippo

•

Dec 19, 2024

• 741

upvoted a paper over 1 year ago

What makes a language easy to deep-learn? Deep neural networks and humans similarly benefit from compositional structure

Paper • 2302.12239 • Published Feb 23, 2023 • 1

upvoted an article over 1 year ago

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

medmekk, marcsun13, lvwerra, pcuenq, osanseviero, thomwolf

•

Sep 18, 2024

• 280

Lukas Galke

AI & ML interests

Recent Activity

Organizations

lgalke's activity

Finally, a Replacement for BERT: Introducing ModernBERT

Fine-tuning LLMs to 1.58bit: extreme quantization made easy