#Mistral 7B

Apple Claraara: The RAG Model That Compresses Knowledge Into Memory Tokens

Apple's Claraara is a new 7B RAG framework that compresses documents into dense memory tokens strings, solving the broken gradient problem and improving retrieval accuracy.