Dataset Construction
A prerequisite to any good testing framework is building a reference dataset to test on. Commonly one of the more tedious parts of the LLM application development process, LangSmith reduces effort by making it easy to save debugging and production traces to datasets. Datasets are collections of either exemplary or problematic inputs and outputs that should be replicated or rectified, respectively.