Private AI
In July 2023, I knocked up a simple AI chatbot using the open source Llama model from Meta. I coded it up from scratch using LangChain. It had the ability to build a vector store from your own proprietary or sensitive documents, enabling you to chat “over them”, without risking un-intentional disclosure. It ran reasonably ok, using a quantized version of Llama, but the main selling point was the complete privacy and zero subscription costs.
read more