Hey there! I see you're curious about tokens and how they affect your usage on StaffUp.ai. Let's break it down in a simple way.
What are Tokens?
Tokens are like puzzle pieces that make up a sentence. When you use StaffUp.ai, your text is divided into these pieces or "tokens". They can be whole words, parts of a word, or even include spaces after a word.
Here's an easy way to understand tokens:
- 1 token is approximately equal to 4 characters in English or about ¾ of a word.
- A short sentence of 1-2 lines is around 30 tokens.
- A paragraph is about 100 tokens.
For example, the quote "You miss 100% of the shots you don't take" contains 11 tokens.
Why are there Token Limits?
We have token limits to ensure pricing simplicity for both you and us. Let me explain further. We use AI models, also known as large language models (LLMs), from OpenAI, which charges us based on tokens. Therefore, we've set limits based on the plan you choose:
What are the usage limits on StaffUp?
The usage limits include all text in the conversation, which means it encompasses your messages, the AI's messages, and any resources included.
- Free Plan: 20,000 tokens per month
- Pro Plan: 500,000 tokens per month
Once you exceed your monthly token limit, you'll need to consider upgrading to a higher plan.
What are the chat length limits?
In addition to the monthly limits, there are also length limits per chat. Remember, each chat you have consumes some of your tokens. The number of tokens used depends on the model you select:
- Fast Chat: Uses up to 4,000 tokens per chat, or 16,000 tokens for Pro users.
- Smart Chat: Uses up to 8,000 tokens per chat
Once you exceed the length limit of a chat, you'll receive a message advising you to either reduce the amount of resources (files), select a different model, or start a new chat.
Note: Chat limits (conversation length) are determined by the AI models (LLMs) themselves. We'll introduce longer chats as they become available to us.
Do resources count towards the limits?
Yes, all resources and files you include in the chat count towards both your monthly limit and the chat length.
Tips to get the most out of your limits
There are a few ways you can optimize your token usage within StaffUp:
- Only include resources (files) in the chats where you need them.
- Break up resources into smaller pieces of important information.
- Ask the AI staff to respond in specific ways, such as sentences or four paragraphs. Feel free to be creative!
How to Estimate Tokens with Text
If you want to get an idea of how many tokens a piece of text might use, check out this handy Tokenizer tool by OpenAI. It allows you to calculate the number of tokens in a text.
Note: We've preprogrammed our Staff to be the best at what they do. This pre-programming introduces default token usage when starting conversations.
