Restrict LLM by token cost
complete
J
John G
We would like to have the ability to create user groups that would prevent them to use high cost LLMs and restrict them to what the admin wants.
VIPs want high token cost LLMs available
Regular users would only have access by cost. Some restricted to medium, some restricted to low.
The idea is for the customer to have some control of usage and token consumption.
M
Mark Leeper
updated the status to
complete
You can restrict LLMs and set Auto modes in custom roles, and assign users to those custom roles
F
Frank Schlatterer
Seconded. This is an excellent idea, and it'd be great for price ranges to be a filter for model selection/allocation to different groups.