Category AI models
Tags AI Models
What longrope is
The technique is described as a Microsoft method that expands a pretrained model context window to 2048k tokens.
What you can do with it
- Extend a short-context model to a long context
- Support machine reading comprehension on long text
What to watch out for
- The listed features are window extension, low-cost fine-tuning and short-context retention
- Work starts from a pretrained large language model
Pros & cons
✓ What we like
- Short-context performance is stated to be preserved
- Training cost and time are described as reduced
! What to watch out for
- The method starts from a pretrained language model
- The named tasks centre on reading, summarisation and long-form text
FAQ
How large is the window?
The material states an extension to 2048k, or 2 million, tokens.
What is preserved?
The material states the original short-context window performance is kept.
Last reviewed: 2026-11-15
More LLM API platform tools
View all →-
302.AI Aggregated cloud platform that hosts hundreds of large models behind one API Developer tools API integration Multi model platform Model deployment LLM API platform -
360智脑开放平台 360 model API platform API integration Multi model platform Knowledge base Q&A Enterprise automation LLM API platform -
4o Image API Image generation API gateway Free tools Freemium tools Developer tools API integration LLM API platform -
AI-Flow No-code multi-model workflows Workflow automation Developer tools API integration Knowledge base Q&A LLM API platform -
AI/ML API Single gateway to many models Developer tools API integration Multimodal Multi model platform LLM API platform -
Amazon Bedrock AWS code suggestions with security scans Free tools Code assistant IDE App builder LLM API platform