Intelligence shouldn’t
be heavy.

We build small language models from scratch, with our own architecture and pretraining, made to run on the devices people already carry.

मरुत् marut, Sanskrit The wind. You feel it everywhere, but you never see the machinery.

Madhuram-v1

Our latest model has 151 million parameters and was pretrained on one trillion tokens. The models we compare it with are larger, and were trained on six to nineteen times more data.

Pretraining tokens, drawn to scale
Madhuram-v1 151M 1T
Gemma 3 270M 6T
LFM2.5 230M 19T

After post-training, it scores above Gemma 3 270M on every benchmark except GPQA Diamond, where all three models are at chance. It leads LFM2.5-230M on BBH, MMLU Pro and GSM8K with chain of thought, and trails it on instruction following, code and GSM8K without chain of thought.

See the full Madhuram-v1 results

Research

Work with us

Finetuning and on-device builds are custom engagements. Tell us about your case and we will tailor the work to it.

Task-specific finetuning

At this size a model is cheap and quick to specialise. We finetune Madhuram on your labels for classification, extraction or routing, and hand back a model that fits your task rather than a general one that approximates it.

Email us about finetuning

On-device deployment

Around 100 MB quantised, fast enough for interactive use on a mid-range phone, with nothing leaving the device. We work with you on the build, quantisation and integration for your hardware.

Email us about on-device deployment

What comes next

With Madhuram v2 we want to go further: larger models than 151M parameters, more training data, and a real step up in capability.

We are looking for investors and partners who believe capable models should run on the devices people already own. If that is you, we would like to hear from you.