Organizations want to infuse LLMs into every part of their planning and decision making process. This translates to thousands, if not millions of API calls a day. While GPT-4 is great, it’s also prohibitively expensive, at scale.
Luckily, the open-source LLM…