# Testing a New LLM in Your Product

By Drew Breunig

When a new model comes out, you need to test it in your pipeline or feature. Follow these steps before you switch in production.

- [ ] Review the documentation of the new LLM to understand its features and improvements.
- [ ] Set up a dedicated testing environment to avoid conflicts with existing models.
- [ ] Integrate the new LLM with your existing pipeline or feature.
- [ ] Run a series of test queries to evaluate performance and accuracy against your use cases.
- [ ] Compare the results of the new LLM with the previous model to identify any significant differences.
- [ ] Monitor resource usage and latency to ensure the new model meets performance expectations.
- [ ] Conduct user testing with a sample group to gather feedback on the new model.
- [ ] Analyze the feedback and performance data to make an informed decision about switching models.
- [ ] Prepare a rollback plan in case the new LLM causes unexpected issues in production.
- [ ] Plan and schedule the switch to the new LLM in your production environment if testing is successful.