Category AI models
What Aria-Base-64K is
The model is described as a multimodal native Mixture-of-Experts base model formed after long-text pretraining, intended for research and continued training.
What you can do with it
- Continue pretraining or finetune on long video QA data
- Work on long document QA after short instruction tuning
Setup and limits
- Install transformers, accelerate and sentencepiece to load it
- Use AutoProcessor for text and image inputs before generation
Pros & cons
✓ What we like
- Quick install and inference code examples are provided
- A codebase supports advanced inference and custom dataset finetuning
! What to watch out for
- The small chat template share may limit direct chat use
- Loading needs transformers, accelerate and sentencepiece installed
FAQ
How much data was used?
The card states 33B tokens, with 21B multimodal, 12B language and 69% long text.
Is it ready for chat?
The card says only about 3% of data used the chat template format.
Last reviewed: 2026-11-15
More LLM API platform tools
View all →-
302.AI Aggregated cloud platform that hosts hundreds of large models behind one API Developer tools API integration Multi model platform Model deployment LLM API platform -
360智脑开放平台 360 model API platform API integration Multi model platform Knowledge base Q&A Enterprise automation LLM API platform -
4o Image API Image generation API gateway Free tools Freemium tools Developer tools API integration LLM API platform -
AI-Flow No-code multi-model workflows Workflow automation Developer tools API integration Knowledge base Q&A LLM API platform -
AI/ML API Single gateway to many models Developer tools API integration Multimodal Multi model platform LLM API platform -
Amazon Bedrock AWS code suggestions with security scans Free tools Code assistant IDE App builder LLM API platform