Auto-scale the default model when credits would otherwise go unused
r
realdavidmckee
Right now if a tenant is going to end the billing period with a pile of unused credits, that value just expires. It would be cool if Hatz could see that usage is on pace to get wasted and auto-scale the default model up a tier for everyone until the pace catches up. For example, an agent that normally runs on a mid-tier model could start using a premium model toward the end of the month, then drop back down when the new period starts.
Would want this to be opt-in at the MSP or tenant level, with a floor and ceiling on which models it can pick so admins stay in control. Users get better answers at the end of the month and the credits we already paid for actually get used.
N
Nick E
Curious, do you find higher tier give better answers or just faster? Maybe depends on the prompt interaction. We are struggling right now with what claude via Hatz.ai gives versus what Claude gives in side by side running comparisons.