Choosing the Right Token Size
When adding content to your AI Assistant's knowledge base, choosing an appropriate token size helps determine how much content is processed together.
The right token size depends on the type and complexity of the content you are adding.
Recommended Token Sizes
| Token Limit | Best For | Examples |
| 256–512 tokens | Short, focused content | FAQs, short articles, product descriptions, support documentation |
| 512–1024 tokens | Medium-length content | Standard manuals, knowledge base articles, company policies |
| 1024+ tokens | Long & Detailed content | Long reports, technical documentation, research papers |