Cascading LLMs

The API Status tools on botmockups provide real-time updates on Anthropic and OpenAI performance.

To ensure your sales demos always run smoothly, we've introduced a cascading LLM feature that automatically keeps your mockups online, even if an API key fails or an LLM goes down. For instance, if your bots are set to our default LLM, Anthropic, and the system detects that the API is down, it will automatically switch to the next available LLM, such as OpenAI.

This feature eliminates the risk of your demos failing during a sales call. While you can add your own keys, there's no need to—we cover all API costs, so you can focus solely on delivering an impressive presentation.