Motherlode
Collection
A 33.4M-parameter code-search encoder fine-tuned from bge-small-en-v1.5, the evidence behind its figures, and a Space that runs it in a browser. • 3 items • Updated • 1
Burton Lancaster PRO
RiverRider
AI & ML interests
Explainable AI
Recent Activity
upvoted a collection 5 days ago
Motherlode reacted to theirpost with 🔥 8 days ago
Motherlode on MTEB and Hugging Face Inference
https://huggingface.co/RiverRider/motherlode-code-small-en-v0.1 is a 33.4 M-parameter English embedding model for code and text. It is a drop-in for bge-small-en-v1.5: the mean of two fine-tunes of that base, one trained to match a GitHub issue to the file that needs changing and one trained to reproduce the geometry of gte-modernbert-base (a 4.5× larger model).
Where it differs on ranking metrics
On the MTEB(Code, v1) MultiSWEbenchRR task it leads the models under 100 M parameters at recall@10 (52.48 versus 52.18 for granite-embedding-small-english-r2). On the clean subset of SWE-bench Verified it improves recall@1 over the base model (178 of 411 versus 145), a gap that holds across the engine settings used in Sunstone. On the CoIR code-search probe it raises nDCG@10 from 0.467 to 0.576.
The gains are concentrated on localization and code retrieval rather than uniform improvement across every MTEB task. The model remains competitive on the broader English MTEB(eng, v2) average (63.47, 4th of 15 under 100 M) while carrying a clear advantage on the code-file tasks it was built for.
The weights are compatible with Hugging Face Inference Providers for feature extraction and sentence similarity. The repository also ships matching ONNX, GGUF, and sentence-transformers exports.
From Sunstone North Lab.
posted an update 8 days ago
Motherlode on MTEB and Hugging Face Inference
https://huggingface.co/RiverRider/motherlode-code-small-en-v0.1 is a 33.4 M-parameter English embedding model for code and text. It is a drop-in for bge-small-en-v1.5: the mean of two fine-tunes of that base, one trained to match a GitHub issue to the file that needs changing and one trained to reproduce the geometry of gte-modernbert-base (a 4.5× larger model).
Where it differs on ranking metrics
On the MTEB(Code, v1) MultiSWEbenchRR task it leads the models under 100 M parameters at recall@10 (52.48 versus 52.18 for granite-embedding-small-english-r2). On the clean subset of SWE-bench Verified it improves recall@1 over the base model (178 of 411 versus 145), a gap that holds across the engine settings used in Sunstone. On the CoIR code-search probe it raises nDCG@10 from 0.467 to 0.576.
The gains are concentrated on localization and code retrieval rather than uniform improvement across every MTEB task. The model remains competitive on the broader English MTEB(eng, v2) average (63.47, 4th of 15 under 100 M) while carrying a clear advantage on the code-file tasks it was built for.
The weights are compatible with Hugging Face Inference Providers for feature extraction and sentence similarity. The repository also ships matching ONNX, GGUF, and sentence-transformers exports.
From Sunstone North Lab.
Organizations
upvoted a collection 5 days ago
upvoted 2
articles 2 months ago
Article
Where the Hivemind Comes From: Geometry, Tuning and Format, Separated on Open Weights
RiverRider
• • 2 Article
We changed one line and the benchmark score moved 0.21 AUROC
FINAL-Bench
• • 12 upvoted a paper 5 months ago