Building efficient conversational AI and language models.
ASTRAI Labs develops language models focused on useful, capable and efficient chatbot experiences.
Models and releases will be published here.
We explore practical methods for improving compact language models through pre-training, supervised fine-tuning, preference optimization, distillation and reasoning-focused training.