Since Nvidia agreed last month to invest $100 billion in its customer OpenAI, investors and analysts who follow artificial intelligence have awakened to that industry’s circularity.
In this tutorial, we show how we treat prompts as first-class, versioned artifacts and apply rigorous regression testing to large language model behavior using MLflow. We design an evaluation pipeline ...