Here at Abacus.AI, we are strong believers in the potential of open source LLMs. The gap in performance with the major commercial closed-sourced models has steadily been decreasing over the last 6 months, thanks to first Llama, then Llama 2, and more recently Mistral and…
Organizations want to infuse LLMs into every part of their planning and decision making process. This translates to thousands, if not millions of API calls a day. While GPT-4 is great, it’s also prohibitively expensive, at scale.
Luckily, the open-source LLM…
Today we release a larger 70B version of Giraffe, succeeding the 13B model we mentioned in a previous blog post. Giraffe is a family of models that are finetuned from base Llama 2 and use context length extension techniques to increase their effective context length…
We have seen an explosion of open-source LLMs lately. While these OSS LLMs have shown comparable performance to closed source LLM APIs offered by OpenAI, Google and others, they suffer from one serious limitation. They only support context lengths of 2K compared to closed…
In this blog post, we discuss Abacus.AI’s NeurIPS 2022 paper on recommender systems.Paper: https://arxiv.org/abs/2206.11886Code: https://github.com/naszilla/reczilla1 min video: https://www.youtube.com/watch?v=Eu8G3oNzcvU5 min video…
The Abacus.AI team has published two papers to appear at the Conference on Neural Information Processing Systems (NeurIPS) 2022. NeurIPS is a top machine learning conference held every December. Abacus.AI is also planning a social event during NeurIPS – stay tuned for…
In our previous post, we presented an introduction to Seq2Seq models – models that take a sequence as an input and produce a sequence for their output. Back in 2014, they revolutionized the field of Natural Language Processing (NLP), especially in translation…
When reading about Machine Learning, the majority of the material you’ve encountered is likely concerned with classification problems. You have a certain input, and the ML model tries to figure out the features of that input. For example, a classification model can decide…
Anyone who’s worked in a manufacturing space can tell you that one of the most significant challenges they face is managing supply chains of the materials and speciality items used to fabricate products. Without clear foresight into demand, how, when and from where…