Restrict LLM by token cost
J
John G
We would like to have the ability to create user groups that would prevent them to use high cost LLMs and restrict them to what the admin wants.
VIPs want high token cost LLMs available
Regular users would only have access by cost. Some restricted to medium, some restricted to low.
The idea is for the customer to have some control of usage and token consumption.
F
Frank Schlatterer
Seconded. This is an excellent idea, and it'd be great for price ranges to be a filter for model selection/allocation to different groups.