Yuriy Gavrilov
hope it will be available for self-hosted version 🙏🙏🙏
Tony Dinh
in progress
Tony Dinh
Merged in a post:
Manage LIMITS for input/output tokens (or characters) ON A PER USER BASIS
S
Stef Becker
FEATURE REQUEST:
A) The possibility to configure and manage LIMITS for input/output tokens (or characters) ON A PER USER BASIS, including fields such as: first name, last name, email, input token/character limit, output token/character limit, AI model.
B) The possibility to have seat-users add their own API key to their TypingMind user account
OUR USE CASE (not unique to our situation):
Please note that the use case described below is NOT unique to my course program. Rather, the 3-step approach described below represents the basic best practices for the promotion, market introduction and scaling of typical B2C online course programs in 2023/24:
THE FOCUS OF MY ONLINE COURSE PROGRAM: Helping people develop EMOTIONAL INTELLIGENCE for personal growth, better relationships, leadership development, and mental health.
OUR COURSE OFFERINGS (3-Step approach outlined above):
STEP 1: A Free 5-Day Bootcamp (mini-course + free AI character)for the promotion and sale of the flagship program. Objective: Building E-mail list
STEP 2: 6-Week Flagship Program "Emotional Intelligence". Objective: Generating Revenue.
STEP 3: Monthly Membership Program. Objectives: Upsell, Cross-Sell, Ongoing revenue stream.
====
FEATURE REQUIREMENTS RELATED TO OUR DESIRED AI USER INTERFACE (Typinig Mind native or API connectors):
To make our market introduction successful and to help us stand-out form the competition, AI must play a central role in our course program. Based on our gap analysis, we have come to the conclusion that the following list of features are currently missing and woulde be required to make our Emotional Intelligence 2.0 course program be unique in the market place. We also feel strongly that the development of some or all of these features will become the norm in the online course and coaching industry over the next 6 to 18 months:
FOR COURSE OFFERING STEP 1 - Free 5-Day Bootcamp:
1) THE FOLLOWING IS A GENERIC REQUIREMENT, VALID FOR A WIDE VARIETY OF ONLINE COURSES: The possibility to design 5, 6, 7, etc... unique AI characters to accompany participants through the tasks of each of the 5,6,7 days or weeks: answering questions to help users filling out daily worksheets, answering questions to course material that has not been understood, explaingin concepts, etc.
*** THIS IS ALREADY POSSIBLE WITH TM, , but it cannot be deployed because it is impossible to manage individual token or character consumption.
2) The possibility to configure and manage LIMITS for input/output tokens (or characters) FOR EACH INDIVIDUAL USER (fields such as: first name, last name, email, token limit, and for which AI model would suffice). Without this possibility, offering a Free 5-Day Bootcamp would be compromised. Here is why:
> hopefully, users will get addicted to asking questions and may 'explode' token consumption (we don't consider users asking a great volume of questions 'spammers'. Rather we consider heavy users a sign of 'success' of the program!)
> we also need to be able to calculate our cost of a "free" 5-Day Bootcamp - and we therefore need to be able to limit the amount of free tokens so that we can stay within our cost parameters.
> We need a possibility to offer and manage additional tokens for users that want to PAY to increase their limits : because these users will likely become our best clients, and buy our flagship program (thats our goal of the Free bootcamp)
*** THIS IS CURRENTLY NOT POSSIBLE WITH TM.
*** PLEASE NOTE: token or character management does not need to be precise - a variation of 5%, 10% or even more is fine for as long as it helps us limit consumption somehow on a per user basis
THE FOLLOWING MAY BE UNIQUE TO LIFE COACHING COURSES IN GENERAL, but remeber that the life coach industry is valued at $1.4 billion, a big pie to be captured by players such as TypingMind:
3) The possibility to deploy are more granular approach to create 'BESPOKE' AI Characters.
> a bespoke AI character for each course participant to create a truly personalized course experience - for example a system prompt based on the results of a free personality test.
> OUR EXAMPLE: When enrolling into our EMOTIONAL INTELLIGENCE Course, users take a free personality test to get their "Pesonality Matrix", as cientifically validated test composed of 3 variables: Personality Type (3) + variation 1 (Type3wing4) + Variation 2 (Type3-7-1).
*** THIS IS ALREADY POSSIBLE WITH TM, but it cannot be deployed because we can't manage individual token/character consumption.
4) The possibility to have end-users pay with their own API key
> To facilitate the ongoing usage of bespoke AI characters, we would love the possibility to have end-users add their own API key to their TypingMind user account so they can keep cost down to a minimum.
*** CURRENTLY NOT POSSIBLE WITH TM
Thank you for taking these suggestions into consideration. We strongly believe adding some or all of these features would add incredible value to TypingMind for offering seats to our customers that can be effectively managed.
Thanks,
Stef
Tony Dinh
Merged in a post:
Add MAX TOKENS PER WEEK, PER MONTH etc for AI Agents
S
Stef Becker
Add time-constraints to the new MAX TOKENS for AI Agent feature
* Generally speaking, but also in a RESELLER scenario we will likely come across different types of AI users: "heavy versus light" users. This will require offering packages at different price points and based on different token limits.
* Just today TheBelleStory posted a new feature allowing to limit agents by total token consumption. Thats GREAT! - And it would probably be the right place to add a feature extension that would allow us to limit tokens with a time-constraint: max tokens per week, mx tokesn per month, max tokens from-to [date], max overall total consumption, for example.
* As computing might slow down requests, maybe compute only once at end of each week, end of each month? (not necessary to compute in 'real time')
* TheBelle asked me to add this as a seperate feature request.
Cheers! Pushing the boundaries of TM for max usefulness and max competitive advantage, Tony! :-)
Stef (aka The Spiderman)
====
PS: Sample calculation for Reseller account enneagramkeys.com:
As a principle, we need to have precise control over the cost of AI-consumption as we are bundling AI agents with our courses. Example: When we will sell an Intro-level course for lets say 147$, we include the access to AI agents in the pricing.. after the course ends, students switch to memberships at 37$/month (prices not final, just to give an idea). In both cases, we need to make sure students dont go over a cerain $$$ threshold when using our TM AI agents (if a student pays 37$/monthfor access to AI, but uses 50$ of tokens, we are loosing money) - BUT: TM does not offer the possibility to limit users by token consumption - only character limits are currently possible.
*Example of pricing structure in a Reseller scenario:
Course price: 147$
Whats included:
Our course management cost: 27$/month/user
TM seat: 8$/month
Token consumption: 20$/month max.
Our Gross profit: 147$ - 27$ - 8$ - 20$ = 92$
Our Net profit before taxes: approx. 80$ (92$ - 12$ variable cost)
Net profit after taxes (Canada): 80$ - 35% = 52$
This example shows you how important it is to us to limit AI token consumption as precisely as possible - overconsumption would directly impact our bottom line.
Tony Dinh
It's strange that you need to have a limit for each user.
But anyway, here is how you can limit the number of message characters per user, for example: user A can only have 50,000 characters per month. This can be done with the current user tags system.
- Create a custom model.
- Assign a limit to the custom model (e.g., 50,000 characters per month)
- Create a unique tags for each user you want to assign the limit to.
- Create an AI agent and assign the custom model to the AI agent, then limit the visibility of this AI agent based on the user tags.
Does this work?
PS: step 1 can be removed if you work out the rules in the model limit setting. You can make a setting to apply to only a specific user tags, but it can get complicated so I suggest creating a custom model for each user to simplify it.
S
Stef Becker
Tony Dinh For my students I can indeed work with character limits Tony. Thank you for illustrating the steps. Stef
S
Stef Becker
Tony Dinh After a lenghty discussion with VA today, herre is an explanation why Resellers likely will require token limits per user:
====
From a business management perspective, we need to have precise control over the cost of AI-consumption as we are bundling AI agents with our courses. Example: When we will sell an Intro-level course for lets say 147$, we include the access to AI agents in the pricing.. after the course ends, students switch to memberships at 37$/month (prices not final, just to give an idea).
* Memberships provide continuous access to AI Agents after the course has ended. For monthly memberships, we need to make sure students dont go over a cerain $$$ threshold when using our TM AI agents (if a student pays 37$/monthfor access to AI, but uses 50$ of tokens, we are loosing money) - TM currently does not offer the possibility to limit users by token consumption - only character limits are currently possible. Its a workaround, but less precise.
*Example of pricing structure in a Reseller scenario:
Course price: 147$
Whats included:
Our course management+seat management cost: 27$/month/user
TM seat: 8$/month
Token consumption: 20$/month max.
Our Gross profit: 147$ - 27$ - 8$ - 20$ = 92$
Our Net profit before taxes: approx. 80$ (92$ - 12$ variable cost)
Net profit after taxes (Canada): 80$ - 35% = 52$
This example shows you the importance of limiting AI token consumption as precisely as possible - overconsumption would directly impact our bottom line.
* WHY limiting tokens "PER USER": some users will require more, some less tokens per month when ona monthly membership plan. This means we would like to offer different AI-access packages for light- vs. heavy users with differnet pricing and differnt token limits.
* Just today TheBelleStory posted a new feature for limiting agents by total token consumption. Thats GREAT! This would probably be the right place to add a feature extension that would allow to limit tokens based on a time-constraint: weekly, monthly, from-to [date] and total token consumtion, for example. TheBelle asked me to add this as a seperate feature request. Will do.
Cheers! I simply love what you and your team are doing, Tony! :-)
Stef (aka The Spiderman)
Sergey PImenov
Stef Becker good idea
b
ben
Yes being able to adjust token limit per model per user per character is very important!’