LEAF: Distillation of State‑of‑the‑Art Text Embedding Models
At MongoDB Research, we’re exploring how to make cutting‑edge AI models smaller, faster, and more flexible. In this blog post, we present LEAF ( Lightweight Embedding Alignment Framework ), a new knowledge distillation framework for text embedding models. We’re also releasing two best‑in‑class embedding models trained with LEAF: mdbr-leaf-ir —23M parameter model optimized for retrieval‑focused tasks like semantic…