Category AI models
Tags AI Models
What Infini-attention is
The technique is described as a Google method that extends Transformer-based large language models to infinitely long inputs using compressive memory.
What you can do with it
- Combine local and long-term attention
- Process inputs in a streaming way
- Run fast streaming inference
Reported tasks
- Long-context language modelling is listed
- Key context block retrieval is listed
- Book summarisation is listed
Pros & cons
✓ What we like
- Streaming processing is supported
- The approach is described as scalable for models
! What to watch out for
- Long inputs rely on compressive memory
- Streaming inference is part of the design
FAQ
Who developed it?
The material states the technique was developed by Google.
Which tasks showed results?
Long-context language modelling, key context block retrieval and book summarisation are named.
Last reviewed: 2026-11-15
More LLM API platform tools
View all →-
302.AI Aggregated cloud platform that hosts hundreds of large models behind one API Developer tools API integration Multi model platform Model deployment LLM API platform -
360智脑开放平台 360 model API platform API integration Multi model platform Knowledge base Q&A Enterprise automation LLM API platform -
4o Image API Image generation API gateway Free tools Freemium tools Developer tools API integration LLM API platform -
AI-Flow No-code multi-model workflows Workflow automation Developer tools API integration Knowledge base Q&A LLM API platform -
AI/ML API Single gateway to many models Developer tools API integration Multimodal Multi model platform LLM API platform -
Amazon Bedrock AWS code suggestions with security scans Free tools Code assistant IDE App builder LLM API platform