Is your feature request related to a problem?
Running evaluations with the GPT 5 mini model results in an error due to the temperature setting incorrectly being carried over from an earlier configuration for the GPT 4o mini model, where it was required. This leads to confusion and prevents successful eval runs.
Describe the solution you'd like
- Ensure that the temperature setting is not included in the config for models that do not require it.
- Correctly clear or ignore the temperature field when switching between models.
Original issue
I was trying to run evals with GPT 5 mini model, but got below error,
So at UI, it correctly didnt ask for temperature to enter. But in its config (on eval run page), temp is showing. And its causing error.
But it seems for same config, earlier version temperateure is getting carried forward, Earlier version was on gpt 4o mini model, and there temp required. So it seems , its not asking it as input, but assuming its not changed and continuing with temp field.
Is your feature request related to a problem?
Running evaluations with the GPT 5 mini model results in an error due to the temperature setting incorrectly being carried over from an earlier configuration for the GPT 4o mini model, where it was required. This leads to confusion and prevents successful eval runs.
Describe the solution you'd like
Original issue
I was trying to run evals with GPT 5 mini model, but got below error,
So at UI, it correctly didnt ask for temperature to enter. But in its config (on eval run page), temp is showing. And its causing error.
But it seems for same config, earlier version temperateure is getting carried forward, Earlier version was on gpt 4o mini model, and there temp required. So it seems , its not asking it as input, but assuming its not changed and continuing with temp field.