Following up on the work from our previous blog post, we are releasing today an arXiv paper titled “Giraffe: Adventures in Expanding Context Lengths in LLMs”.
Giraffe is a new family of models that are finetuned from base LLaMA and LLaMA2 that we release. We include a…
The launch of ChatGPT has created a pivotal moment, enabling enterprises to envision new use cases and accelerated the adoption of AI within these corporations. One such use case in the enterprise space is the ability to have a conversation with a chatbot and get answers to…
We have seen an explosion of open-source LLMs lately. While these OSS LLMs have shown comparable performance to closed source LLM APIs offered by OpenAI, Google and others, they suffer from one serious limitation. They only support context lengths of 2K compared to closed…
In this blog post, we discuss Abacus.AI’s NeurIPS 2022 paper on recommender systems.Paper: https://arxiv.org/abs/2206.11886Code: https://github.com/naszilla/reczilla1 min video: https://www.youtube.com/watch?v=Eu8G3oNzcvU5 min video…
The Abacus.AI team has published two papers to appear at the Conference on Neural Information Processing Systems (NeurIPS) 2022. NeurIPS is a top machine learning conference held every December. Abacus.AI is also planning a social event during NeurIPS – stay tuned for…
In our previous post, we presented an introduction to Seq2Seq models – models that take a sequence as an input and produce a sequence for their output. Back in 2014, they revolutionized the field of Natural Language Processing (NLP), especially in translation…
When reading about Machine Learning, the majority of the material you’ve encountered is likely concerned with classification problems. You have a certain input, and the ML model tries to figure out the features of that input. For example, a classification model can decide…
Anyone who’s worked in a manufacturing space can tell you that one of the most significant challenges they face is managing supply chains of the materials and speciality items used to fabricate products. Without clear foresight into demand, how, when and from where…
E-commerce is the new normal for many consumers, never more so than in these times of quarantine and social distancing. As an alternative for the traditional brick-and-mortar storefront, online purchasing has spent the last couple decades transforming the retail…