Madhuram-v1
Our latest model has 151 million parameters and was pretrained on one trillion tokens. The models we compare it with are larger, and were trained on six to nineteen times more data.
After post-training, it scores above Gemma 3 270M on every benchmark except GPQA Diamond, where all three models are at chance. It leads LFM2.5-230M on BBH, MMLU Pro and GSM8K with chain of thought, and trails it on instruction following, code and GSM8K without chain of thought.
Research
We publish our benchmarks, our methods and our failures as we go.
- Madhuram-v1151M parameters and 1T tokens, with pretraining and post-training results against models trained on up to 19 times as much data.
- Madhuram-v0.6: technical guideA 16K context window and full benchmark results against SmolLM2, Gemma 3 and LFM2.5.
- Madhuram on deviceMobile inference benchmarks and comparisons, measured on a phone.
- Madhuram-v0.5: technical guideArchitecture details, benchmarks and performance comparisons.
- Building Madhuram-TranslateA translation model built on our Indic tokenizer, with minimal data and hardware.
- Perseus: efficient language modellingRethinking positional embeddings to get more out of a small model.
Work with us
Finetuning and on-device builds are custom engagements. Tell us about your case and we will tailor the work to it.
Task-specific finetuning
At this size a model is cheap and quick to specialise. We finetune Madhuram on your labels for classification, extraction or routing, and hand back a model that fits your task rather than a general one that approximates it.
Email us about finetuningOn-device deployment
Around 100 MB quantised, fast enough for interactive use on a mid-range phone, with nothing leaving the device. We work with you on the build, quantisation and integration for your hardware.
Email us about on-device deploymentWhat comes next
With Madhuram v2 we want to go further: larger models than 151M parameters, more training data, and a real step up in capability.
We are looking for investors and partners who believe capable models should run on the devices people already own. If that is you, we would like to hear from you.