Abstract: Large Language Models have emerged as the top-notch tool in the software engineering field, from requirement gathering and analysis to code generation. Several approaches have been developed ...

In this tutorial, we show how we treat prompts as first-class, versioned artifacts and apply rigorous regression testing to large language model behavior using MLflow. We design an evaluation pipeline ...