Hosting the Kimi Linear AttnRes model checkpoint on Hugging Face.
Raw Developer Origin & Technical Request
GitHub Issue
Mar 17, 2026
Hi @yzhangcs 🤗
I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work through Hugging Face's daily papers as yours got featured: huggingface.co/papers/2603.15031
The paper page lets people discuss about your paper and lets them find artifacts about it (your models for instance),
you can also claim the paper as yours which will show up on your public profile at HF, add Github and project page URLs.
Your paper introduces "Attention Residuals" and mentions integrating it into the Kimi Linear architecture (48B total / 3B activated parameters), pre-training it on 1.4T tokens, and evaluating its improved downstream performance. The paper also states that the weights for this model are available at your GitHub repository. It would be fantastic if you would consider hosting this pre-trained Kimi Linear AttnRes model checkpoint on huggingface.co/models!
Hosting on Hugging Face will give you more visibility/enable better discoverability. We can add tags in the model cards so that people find the models easier, link it to the paper page, etc.
If you're interested, here's a guide: huggingface.co/docs/hub/models-u... If it's a custom PyTorch model, you can use the [PyTorchModelHubMixin](huggingface.co/docs/huggingface_...
class which adds `from_pretrained` and `push_to_hub` to the model, allowing users to download and use models right away.
Alternat...
Developer Debate & Comments
No active discussions extracted for this entry yet.
Adjacent Repository Pain Points
Other highly discussed features and pain points extracted from MoonshotAI/Attention-Residuals.
合影
Engagement Signals
Cross-Market Term Frequency
Quantifies the cross-market adoption of foundational terms like Attention Residuals and Kimi Linear architecture by tracking occurrence frequency across active SaaS architectures and enterprise developer debates.
Market Trends