Release catalog
Models & thinking levels
Explore model configurations from direct model calls across recorded thinking levels. Provider release dates and specifications are listed when verified.
| Model | Execution | Thinking | Acceptable rate |
|---|---|---|---|
| Direct | default | 67.35% | |
| Direct | disabled | 62.54% | |
| Direct | high | 66.86% | |
| Direct | low | 66.87% | |
| Direct | medium | 66.73% | |
| Direct | minimal | 66.92% | |
| Direct | xhigh | 67.06% | |
| Direct | default | 66.12% | |
| Direct | disabled | 61.83% | |
| Direct | high | 66.20% | |
| Direct | low | 66.18% | |
| Direct | medium | 65.97% | |
| Direct | minimal | 65.77% | |
| Direct | xhigh | 65.79% |
Historical results. Each row represents a distinct configuration; scores are not pooled. Historical evaluation and publication dates have not been verified.